Filesystem full: /dev/sda3 Free=0%

General questions.
Post Reply
ogudet
Posts: 2
Joined: March 25th, 2015, 8:27 pm

Filesystem full: /dev/sda3 Free=0%

Post by ogudet » November 8th, 2019, 1:47 pm

Hello,

That seems that is the first time I see this message on the home page: Filesystem full: /dev/sda3 Free=0%
Is that really a problem, because the SSD is really not full ?

Filesystem 1K-blocks Used Available Use% Mounted on
devtmpfs 2056860 4 2056856 1% /dev
tmpfs 2064868 0 2064868 0% /dev/shm
tmpfs 2064868 556 2064312 1% /run
/dev/sda3 1998672 1969840 0 100% /
/dev/sda1 60400 49648 6168 89% /boot
/dev/sda4 58516128 3238908 52281692 6% /var
/var/loc 8192 12 8180 1% /var/lock
none 2064868 32 2064836 1% /var/log/vnstat
none 2064868 33468 2031400 2% /var/log/rrd

thx in advance for help

Olivier
Attachments
Capture d’écran 2019-11-08 à 14.32.29.png
Capture d’écran 2019-11-08 à 14.31.50.png

renatohtpc
Posts: 20
Joined: August 16th, 2018, 9:17 pm

Re: Filesystem full: /dev/sda3 Free=0%

Post by renatohtpc » November 9th, 2019, 1:10 am

I have the same thing.

In my case, I found several directories under /tmp.

They contained a single HUGE files.

As I did a tail -100 on one of them, I saw the following:

Code: Select all

"223.255.128.0","223.255.191.255","3758063616","3758079999","HK","Hong Kong"
"223.255.192.0","223.255.223.255","3758080000","3758088191","KR","South Korea"
"223.255.224.0","223.255.231.255","3758088192","3758090239","ID","Indonesia"
"223.255.232.0","223.255.235.255","3758090240","3758091263","AU","Australia"
"223.255.236.0","223.255.239.255","3758091264","3758092287","CN","China"
"223.255.240.0","223.255.243.255","3758092288","3758093311","HK","Hong Kong"
"223.255.244.0","223.255.247.255","3758093312","3758094335","IN","India"
"223.255.248.0","223.255.251.255","3758094336","3758095359","HK","Hong Kong"
"223.255.252.0","223.255.253.255","3758095360","3758095871","CN","China"
"223.255.254.0","223.255.254.255","3758095872","3758096127","SG","Singapore"
"223.255.255.0","223.255.255.255","3758096128","3758096383","AU","Australia"

So........

I deleted a few of the folders with a timestamp earlier than today!

Does anybody know where these files are coming from?

Renato

BeBiMa
Posts: 2842
Joined: July 30th, 2011, 12:55 pm
Location: Mannheim

Re: Filesystem full: /dev/sda3 Free=0%

Post by BeBiMa » November 10th, 2019, 12:38 pm

I think this are the raw files for GeoIP. These should be deleted after generation of the database, used by IPFire.
Image
Unitymedia Cable Internet ( 32MBit )

renatohtpc
Posts: 20
Joined: August 16th, 2018, 9:17 pm

Re: Filesystem full: /dev/sda3 Free=0%

Post by renatohtpc » November 10th, 2019, 9:50 pm

Well

on my system they are not being deleted.

As of Nov 10th at 4:46PM, this is what I am seeing:

Code: Select all

drwxr-xr-x 2 root root 4096 Nov 10 06:15 tmp.48TuchYT99
drwxr-xr-x 2 root root 4096 Nov 10 06:33 tmp.BAcFs03gip
drwxr-xr-x 2 root root 4096 Nov 10 06:41 tmp.QY79REWkEC
drwxr-xr-x 2 root root 4096 Nov 10 06:43 tmp.NrEWOoxfSt
drwxr-xr-x 2 root root 4096 Nov 10 06:44 tmp.T5O9OK8nxS
drwxr-xr-x 2 root root 4096 Nov 10 06:47 tmp.e9yRk3Fkch
drwxr-xr-x 2 root root 4096 Nov 10 06:50 tmp.67soKCuIon
drwxr-xr-x 2 root root 4096 Nov 10 06:52 tmp.hBzrGxMnvo
drwxr-xr-x 2 root root 4096 Nov 10 07:12 tmp.y5VlbzlSHq
drwxr-xr-x 2 root root 4096 Nov 10 08:14 tmp.Qx7WUTsrJj
drwxr-xr-x 2 root root 4096 Nov 10 08:16 tmp.MqilfdCKkV
drwxr-xr-x 2 root root 4096 Nov 10 08:25 tmp.SKbB1mDlT2
drwxr-xr-x 2 root root 4096 Nov 10 08:34 tmp.C9hDpJxK4w
drwxr-xr-x 2 root root 4096 Nov 10 09:06 tmp.5kuBliFku8
drwxr-xr-x 2 root root 4096 Nov 10 09:21 tmp.ahdAQVWKAX
drwxr-xr-x 2 root root 4096 Nov 10 09:32 tmp.Z71zPTtYJD
drwxr-xr-x 2 root root 4096 Nov 10 09:46 tmp.oqh3eWZYiW
drwxr-xr-x 2 root root 4096 Nov 10 10:37 tmp.k7jUCIZHPy
drwxr-xr-x 2 root root 4096 Nov 10 10:43 tmp.NJTcT5vTvz
drwxr-xr-x 2 root root 4096 Nov 10 10:46 tmp.AYOPAvsOTL
drwxr-xr-x 2 root root 4096 Nov 10 10:54 tmp.LqYFZb99to
drwxr-xr-x 2 root root 4096 Nov 10 10:55 tmp.NqqtJyRI6D
drwxr-xr-x 2 root root 4096 Nov 10 11:21 tmp.3XT3VYzZOG
drwxr-xr-x 2 root root 4096 Nov 10 11:27 tmp.wN0IgDnrMK
drwxr-xr-x 2 root root 4096 Nov 10 11:54 tmp.Yfc7fiREpl
drwxr-xr-x 2 root root 4096 Nov 10 12:23 tmp.GhroJlyPC8
drwxr-xr-x 2 root root 4096 Nov 10 12:49 tmp.6hZosjstjP
drwxr-xr-x 2 root root 4096 Nov 10 12:53 tmp.BTdURcNsyq
drwxr-xr-x 2 root root 4096 Nov 10 12:54 tmp.o9bNDrojZD
drwxr-xr-x 2 root root 4096 Nov 10 13:08 tmp.p9zcjtpUq9
drwxr-xr-x 2 root root 4096 Nov 10 13:42 tmp.Eah4869apr
drwxr-xr-x 2 root root 4096 Nov 10 13:52 tmp.E1umNaY4RD
drwxr-xr-x 2 root root 4096 Nov 10 14:34 tmp.vbKcshbwHY
drwxr-xr-x 2 root root 4096 Nov 10 15:13 tmp.YvdjLjjwJj

and this is the space used:

Code: Select all

du -h --max-depth=1 /tmp
25M	/tmp/tmp.48TuchYT99
25M	/tmp/tmp.hBzrGxMnvo
25M	/tmp/tmp.NqqtJyRI6D
25M	/tmp/tmp.MqilfdCKkV
25M	/tmp/tmp.GhroJlyPC8
25M	/tmp/tmp.Qx7WUTsrJj
25M	/tmp/tmp.p9zcjtpUq9
25M	/tmp/tmp.5kuBliFku8
25M	/tmp/tmp.YvdjLjjwJj
25M	/tmp/tmp.QY79REWkEC
25M	/tmp/tmp.oqh3eWZYiW
25M	/tmp/tmp.3XT3VYzZOG
25M	/tmp/tmp.y5VlbzlSHq
25M	/tmp/tmp.BAcFs03gip
25M	/tmp/tmp.ahdAQVWKAX
25M	/tmp/tmp.E1umNaY4RD
25M	/tmp/tmp.vbKcshbwHY
25M	/tmp/tmp.LqYFZb99to
25M	/tmp/tmp.SKbB1mDlT2
25M	/tmp/tmp.e9yRk3Fkch
25M	/tmp/tmp.T5O9OK8nxS
25M	/tmp/tmp.Eah4869apr
25M	/tmp/tmp.NrEWOoxfSt
25M	/tmp/tmp.C9hDpJxK4w
25M	/tmp/tmp.67soKCuIon
25M	/tmp/tmp.NJTcT5vTvz
25M	/tmp/tmp.AYOPAvsOTL
25M	/tmp/tmp.wN0IgDnrMK
25M	/tmp/tmp.Yfc7fiREpl
25M	/tmp/tmp.o9bNDrojZD
25M	/tmp/tmp.BTdURcNsyq
25M	/tmp/tmp.k7jUCIZHPy
25M	/tmp/tmp.Z71zPTtYJD
25M	/tmp/tmp.6hZosjstjP
Thanks
Renato

User avatar
Arne.F
Core Developer
Core Developer
Posts: 8519
Joined: May 7th, 2006, 8:57 am
Location: BS <-> NDH
Contact:

Re: Filesystem full: /dev/sda3 Free=0%

Post by Arne.F » November 11th, 2019, 9:49 am

The leftover is a known bug introduced with core136 and should fixed in core137.

You can save delete this tmp Files.

But why you have so much of it. Normal this should done once at connection up. (because there is a second bug also fixed in core137)
now it should run once per month.
Arne

Support the project on the donation!

Image

Image

Image
PS: I will not answer support questions via email and ignore IPFire related messages on my non IPFire.org mail addresses.

renatohtpc
Posts: 20
Joined: August 16th, 2018, 9:17 pm

Re: Filesystem full: /dev/sda3 Free=0%

Post by renatohtpc » November 11th, 2019, 12:45 pm

Arne

some more information.

As of Nov 11th at 7:41AM

Code: Select all

drwx------ 2 root root 4096 Nov 10 16:49 mc-root
drwxr-xr-x 2 root root 4096 Nov 10 22:32 tmp.qilB8JYX0T
drwxr-xr-x 2 root root 4096 Nov 10 22:34 tmp.CJP6zqM6fv
drwxr-xr-x 2 root root 4096 Nov 10 22:36 tmp.30dDopYNr6
drwxr-xr-x 2 root root 4096 Nov 10 22:57 tmp.sTHCd5RvF4
drwxr-xr-x 2 root root 4096 Nov 10 23:00 tmp.RuSpFXq08x
drwxr-xr-x 2 root root 4096 Nov 10 23:29 tmp.C3lgljwp94
drwxr-xr-x 2 root root 4096 Nov 10 23:32 tmp.RC5y9rgbSm
drwxr-xr-x 2 root root 4096 Nov 11 00:17 tmp.5n7padfDvI
drwxr-xr-x 2 root root 4096 Nov 11 01:24 tmp.UQsBOwykWZ
drwxr-xr-x 2 root root 4096 Nov 11 01:43 tmp.mHexAIP2KN
drwxr-xr-x 2 root root 4096 Nov 11 01:57 tmp.TcNKlZ7S0V
drwxr-xr-x 2 root root 4096 Nov 11 02:26 tmp.O7Cgw1Zjz5
drwxr-xr-x 2 root root 4096 Nov 11 02:30 tmp.oSc0Jagtit
drwxr-xr-x 2 root root 4096 Nov 11 03:16 tmp.jwsysQUTMJ
drwxr-xr-x 2 root root 4096 Nov 11 03:26 tmp.7fNCKYmft7
drwxr-xr-x 2 root root 4096 Nov 11 03:29 tmp.a94bYB9kRV
drwxr-xr-x 2 root root 4096 Nov 11 03:42 tmp.IhjZVJIXH3
drwxr-xr-x 2 root root 4096 Nov 11 04:09 tmp.f6g3Q4hSzD
drwxr-xr-x 2 root root 4096 Nov 11 04:18 tmp.D2EtzY294U
drwxr-xr-x 2 root root 4096 Nov 11 04:30 tmp.4XTsWvhoww
drwxr-xr-x 2 root root 4096 Nov 11 04:59 tmp.xCvbiXmrhF
drwxr-xr-x 2 root root 4096 Nov 11 05:22 tmp.Ghg5YayIvB
drwxr-xr-x 2 root root 4096 Nov 11 05:50 tmp.7zp47cDoAb
drwxr-xr-x 2 root root 4096 Nov 11 06:01 tmp.1BFWjJQoKm
drwxr-xr-x 2 root root 4096 Nov 11 06:26 tmp.tOLG7k7lsn
drwxr-xr-x 2 root root 4096 Nov 11 06:37 tmp.figq1dRrRW
drwxr-xr-x 2 root root 4096 Nov 11 07:22 tmp.Kah9D0QP7f
Also, I did a quick wc -l on a few of them and they all appear to have the same number of records.

Code: Select all

[root@ipfirePA tmp]# wc -l tmp.1BFWjJQoKm/tmp.QEzQ0GTXOB
340538 tmp.1BFWjJQoKm/tmp.QEzQ0GTXOB
[root@ipfirePA tmp]# wc -l tmp.30dDopYNr6/tmp.fNJscI7o4r
340538 tmp.30dDopYNr6/tmp.fNJscI7o4r
[root@ipfirePA tmp]# wc -l tmp.4XTsWvhoww/tmp.qtyjN8FG7K
340538 tmp.4XTsWvhoww/tmp.qtyjN8FG7K
[root@ipfirePA tmp]# wc -l tmp.5n7padfDvI/tmp.o272pn1uyB
340538 tmp.5n7padfDvI/tmp.o272pn1uyB
Is it possible for me to stop/disable this process until a fix is available?


Thanks
Renato

User avatar
Arne.F
Core Developer
Core Developer
Posts: 8519
Joined: May 7th, 2006, 8:57 am
Location: BS <-> NDH
Contact:

Re: Filesystem full: /dev/sda3 Free=0%

Post by Arne.F » November 11th, 2019, 1:59 pm

edit /usr/local/bin/xt_geoip_update
and insert a line 2 with
exit 0

this will disable the update until core127 update. (planned release is in this week)
Arne

Support the project on the donation!

Image

Image

Image
PS: I will not answer support questions via email and ignore IPFire related messages on my non IPFire.org mail addresses.

renatohtpc
Posts: 20
Joined: August 16th, 2018, 9:17 pm

Re: Filesystem full: /dev/sda3 Free=0%

Post by renatohtpc » November 12th, 2019, 5:41 am

Arne

I believe I may have identified the source of the problem......

My configuration has 3 zones, red, green and blue running on a HP 6200 Pro with i5-2500 CPU @ 3.30GHz and 16Gig of RAM 128G SSD drive.

The system has a "built-in" gigabit ethernet card. Initially, I had installed 3 intel PCI-Express cards, one for each zone.

A few days ago, I decided to eliminate one of the cards and use the builtin ethernet card for the red zone. That's when I believe the problem started!!!

At the same time I also noticed that the internet connection was VERY unstable. I did not connect the 2 together. Also, at the time I issued the following:

tail -f /var/log/messages|grep dhcpcd
and saw a significant number of records in some cases seconds apart. If I remember correctly, the entries were specific to the WAN.

About 4 hrs ago, I decided to revert back to the original configuration (i.e. zone red running on a dedicated PCI-Express card). Reconfigured IPFire and removed the "exit 0" command from the script (as per you last suggestion).

Result:
The /tmp folder is now empty and the internet connection appears to be stable again. I will know more tomorrow morning my time as I will be on countless conference calls using VOIP........

I issued again the tail -f /var/log/messages|grep dhcpcd and everything appears to be quiet (note, I just ran it for only about 10 mins) for the most part with the exception of this entry:

Nov 12 00:32:18 ipfirePA dhcpcd[7210]: red0: failed to renew DHCP, rebinding
Nov 12 00:32:18 ipfirePA kernel: dhcpcd[7210]: segfault at 7ffd772ff000 ip 0000000000423a3c sp 00007ffd772fd150 error 4 in dhcpcd[407000+33000]

BTW,
[root@ipfirePA log]# dhcpcd --version
dhcpcd 8.0.3

Out of curiosity, do you know why ipfire does not appear to care for the builtin ethernet?

Thanks again for your support.

Renato

User avatar
Arne.F
Core Developer
Core Developer
Posts: 8519
Joined: May 7th, 2006, 8:57 am
Location: BS <-> NDH
Contact:

Re: Filesystem full: /dev/sda3 Free=0%

Post by Arne.F » November 12th, 2019, 6:45 am

Looks also like a known bug. dchpcd 8.0x is unstable on some systems so we will downgrade it in core137.

Edit: corrected version 127>137
Arne

Support the project on the donation!

Image

Image

Image
PS: I will not answer support questions via email and ignore IPFire related messages on my non IPFire.org mail addresses.

DJ-Melo
Posts: 675
Joined: July 8th, 2014, 7:12 am

Re: Filesystem full: /dev/sda3 Free=0%

Post by DJ-Melo » November 12th, 2019, 7:49 am

Arne.F wrote:
November 12th, 2019, 6:45 am
Looks also like a known bug. dchpcd 8.0x is unstable on some systems so we will downgrade it in core127.
i think you mean Core 137.

User avatar
Arne.F
Core Developer
Core Developer
Posts: 8519
Joined: May 7th, 2006, 8:57 am
Location: BS <-> NDH
Contact:

Re: Filesystem full: /dev/sda3 Free=0%

Post by Arne.F » November 12th, 2019, 8:26 am

Thx for the hint.
Arne

Support the project on the donation!

Image

Image

Image
PS: I will not answer support questions via email and ignore IPFire related messages on my non IPFire.org mail addresses.

Post Reply