Troubleshoot FTP

From FOG Project
Revision as of 16:27, 4 October 2015 by Wayne-workman.28155 (talk | contribs) (→‎Images stuck in /images/dev)
Jump to: navigation, search


FTP's roles in FOG

The primary purpose is moving & renaming image files in the /images/dev folder to the /images folder at the end of an image capture. FTP is not used for image upload or download because NFS is faster. FTP is also used to download kernels and delete images. FTP is also used to report "Image Size: ON SERVER". FTP is also used to ensure the image you wish to deploy exists before starting an image deployment. It's also used for syncing between storage nodes, and putting snapins on storage nodes.

FTP should be able to read, write, and delete in /images/dev and /images.

Testing FTP

Try to get a file with Linux:

These commands are NOT done on your FOG server, they are done on another Linux machine (this example uses Fedora).

To explain what's happening below in the code box,

  • Create a test file with some data in it to send later.
  • Start ftp (may need installed first).
  • Open connection to FOG server.
  • Provide username.
  • Provide password.
  • Change to /images directory.
  • List directory contents.
  • Upload file.
  • List directory contents to verify.
  • Download the file.
  • Delete the file.
  • Exit ftp.
[administrator@D620 ~]$ echo 'some text here to send later' > test.txt
[administrator@D620 ~]$ ftp
ftp> open 10.0.0.3
Connected to 10.0.0.3 (10.0.0.3).
220 (vsFTPd 3.0.2)
Name (10.0.0.3:administrator): fog
331 Please specify the password.
Password:
230 Login successful.
Remote system type is UNIX.
Using binary mode to transfer files.
ftp> cd /images
250 Directory successfully changed.
ftp> ls
227 Entering Passive Mode (10,0,0,3,204,176).
150 Here comes the directory listing.
drwxrwxrwx    2 0        0            4096 Apr 10 03:38 Optiplex745WinXPconfiguredApril2015
drwxrwxrwx    2 0        0            4096 Apr 10 03:39 dev
drwxrwxrwx    2 0        0           16384 Apr 07 01:58 lost+found
drwxrwxrwx    2 0        0            4096 Apr 08 00:59 postdownloadscripts
226 Directory send OK.
ftp> put test.txt
local: test.txt remote: test.txt
227 Entering Passive Mode (10,0,0,3,132,59).
150 Ok to send data.
226 Transfer complete.
29 bytes sent in 0.000114 secs (254.39 Kbytes/sec)
ftp> ls
227 Entering Passive Mode (10,0,0,3,118,48).
150 Here comes the directory listing.
drwxrwxrwx    2 0        0            4096 Apr 10 03:38 Optiplex745WinXPconfiguredApril2015
drwxrwxrwx    2 0        0            4096 Apr 10 03:39 dev
drwxrwxrwx    2 0        0           16384 Apr 07 01:58 lost+found
drwxrwxrwx    2 0        0            4096 Apr 08 00:59 postdownloadscripts
-rw-r--r--    1 1000     1000           29 Apr 30 00:29 test.txt
226 Directory send OK.
ftp> get test.txt
local: test.txt remote: test.txt
227 Entering Passive Mode (10,0,0,3,190,81).
150 Opening BINARY mode data connection for test.txt (29 bytes).
226 Transfer complete.
29 bytes received in 0.000529 secs (54.82 Kbytes/sec)
ftp> delete test.txt
250 Delete operation successful.
ftp> exit
421 Timeout.
[administrator@D620 ~]$

Try to get a file with Windows:

Explanation of the code below:

  • Create a file with some data
  • Start FTP
  • Open connection to FOG server
  • Enter username
  • Enter password
  • Upload file
  • List directory to verify
  • Download file
  • Close connection
  • Close FTP.
c:\SomeFolder>echo This is a bit of text to throw into a file > text.txt

c:\SomeFolder>ftp
ftp> open 10.0.0.3
Connected to 10.0.0.3.
220 (vsFTPd 3.0.2)
User (10.0.0.3:(none)): fog
331 Please specify the password.
Password:
230 Login successful.
ftp> put text.txt
200 PORT command successful. Consider using PASV.
150 Ok to send data.
226 Transfer complete.
ftp: 45 bytes sent in 0.00Seconds 22.50Kbytes/sec.
ftp> ls
200 PORT command successful. Consider using PASV.
150 Here comes the directory listing.
text.txt
226 Directory send OK.
ftp: 10 bytes received in 0.00Seconds 10.00Kbytes/sec.
ftp> get text.txt
200 PORT command successful. Consider using PASV.
150 Opening BINARY mode data connection for text.txt (45 bytes).
226 Transfer complete.
ftp: 45 bytes received in 0.00Seconds 45000.00Kbytes/sec.
ftp> close
221 Goodbye.
ftp> quit

c:\SomeFolder>

FTP Service

Fedora 20/21

  • Check the status of FTP with 
systemctl status vsftpd.service
(should be on and green, no errors, and enabled)
  • stop, start, disable and enable FTP service.
systemctl stop vsftpd.service
systemctl start vsftpd.service
systemctl disable vsftpd.service
systemctl enable vsftpd.service
  • Test that it’s functioning by using the testing instructions at the top of this article additionally, if you open a web browser and go to 
ftp://x.x.x.x
  • Use fog / your-fog-account-Password for the credentials
  • You should see “Index of /”

Ubuntu

  • Restart FTP service.
/etc/init.d/vsftpd restart
  • Enable and disable are not available due to this service being in the Upstart scripts.
  • Test that it’s functioning by using the testing instructions at the top of this article additionally, if you open a web browser and go to 
ftp://x.x.x.x
  • Use fog / your-fog-account-Password for the credentials
  • You should see “Index of /”

FTP Settings File

Fedora 20/21:

Location: 

/etc/vsftpd/vsftpd.conf

To display file: 

cat /etc/vsftpd/vsftpd.conf

It should look a lot like this: 

anonymous_enable=NO
local_enable=YES
write_enable=YES
local_umask=022
dirmessage_enable=YES
xferlog_enable=YES
connect_from_port_20=YES
xferlog_std_format=YES
listen=YES
pam_service_name=vsftpd
userlist_enable=NO
tcp_wrappers=YES
seccomp_sandbox=NO

To edit: 

vi /etc/vsftpd/vsftpd.conf

Explanation of settings: 

man vsftpd.conf


Ubuntu

Location: 

/etc/vsftpd.conf

To display file: 

cat /etc/vsftpd.conf

It should look a lot like this: 

anonymous_enable=NO
local_enable=YES
write_enable=YES
local_umask=022
dirmessage_enable=YES
xferlog_enable=YES
connect_from_port_20=YES
xferlog_std_format=YES
listen=YES
pam_service_name=vsftpd
userlist_enable=NO
tcp_wrappers=YES
seccomp_sandbox=NO

To edit: 

vi /etc/vsftpd.conf

Explanation of settings: 

man vsftpd

Instructions on using Vi: Vi

Disable & Verify Firewall

Fedora 20/21/22/23

Disable/stop Firewall 

systemctl disable firewalld.service
systemctl stop firewalld.service

Can be undone with "start" and "enable".

Check Firewall in Fedora 20/21/22/23 

systemctl status firewalld.service

Fedora 16

Add /bin/bash to /etc/shells as the vsftpd yum install does not do it correctly causing tftp timeout message


Debian/Ubuntu

sudo iptables -L

If disabled, the output should look like this: 

Chain INPUT (policy ACCEPT)
target prot opt source destination 

Chain FORWARD (policy ACCEPT)
target prot opt source destination 

Chain OUTPUT (policy ACCEPT)
target prot opt source destination

Disable Ubuntu Firewall 

sudo ufw disable

Disable Debian Firewall 

iptables -F
iptables -X
iptables -t nat -F
iptables -t nat -X
iptables -t mangle -F
iptables -t mangle -X
iptables -P INPUT ACCEPT
iptables -P OUTPUT ACCEPT
iptables -P FORWARD ACCEPT

Other debian settings: 

/etc/hosts.deny

This setting in the above file will deny traffic from any source except locally: 

ALL:ALL EXCEPT 127.0.0.1:DENY

Comment out this line like so: 

#ALL:ALL EXCEPT 127.0.0.1:DENY

Windows 7

Start -> Control Panel -> View by "Small icons" -> Windows Firewall -> Turn Windows Firewall On or Off -> Turn off all three.

Configuring firewall on Linux

To set the firewall for Linux to only allow what is necessary, please see the FOG security article.


Credentials / Passwords

There are a few places where all the credentials (on a standard install) should match exactly.

  • Web Interface -> Storage Management -> Your storage node -> Management Username & Management Password
  • Web Interface -> FOG Configuration -> FOG Settings -> TFTP Server -> FOG_TFTP_FTP_USERNAME & FOG_TFTP_FTP_PASSWORD
  • The local 'fog' user's password on the Linux FOG server
  • /opt/fog/.fogsettings -> storageftpuser & storageftppass (For recent FOG Trunk versions only. 1.2.0 does not have this setting. 1.3.0 will though.)


All four of those should match (again, on a standard installation).


To change the password of the local fog user: 

sudo passwd fog


To edit /opt/fog/.fogsettings: 

vi /opt/fog/.fogsettings

Instructions on using Vi: Vi

Permissions

The credentials used for this:

Storage Management -> Storage Node -> Management Username / Management Password

Should exactly match the ownership of the /images directory and all of it's contents. The path should also match the actual path to your images directory.


You can check the permissions on all your image files with this: 

ls -laR /images


You can enable all permissions (just for troubleshooting) on the /images directory recursively like this: 

sudo chmod -R 777 /images


Normally, /images and all of it's contents should be owned by the local fog user. Whoever the owner is, that's the credentials you should use in you're storage node username / password fields.

You can set ownership like this: 

sudo chown -R fog:root /images

Common problems and fixes

My problem isn't in the WiKi!

If you have a problem with FOG, or have a solution to a problem with FOG, please visit the forums for help or to report your solution. We try to keep the WiKi updated with things found in the forum. You can visit the forum here: FOG Forums


Image Size on server: 0

This is a common problem, and is almost always due to FTP credentials being incorrect. Please see the "Credentials" section above.



You must first upload an image to create a download task

You may get this message when you try to deploy an image to computers.

YouMustFirstuploadAnImageToCreateDownloadTask.png

FTP is used to validate that an image exists before creating an image task. When an image does exist, but can't be verified or has not been moved from /dev to /images, then you will see this error.

Please see Troubleshoot_FTP#Credentials_.2F_Passwords above to correct the problem.

Source: Deployment/FTP not working

Images stuck in /images/dev

Images upload and are stored in /images/dev/[mac address of host] and they're never moved to /images

Error messages on client at end of upload, being close to completed:

  • FTP move failed
  • FTP error
  • Can't rename/move Permission Denied
  • FOGFTP failed to rename file


Solutions:


Please see Troubleshoot_FTP#Credentials_.2F_Passwords above to correct the problem.


Ensure the permissions on /images and /images/dev are correct. See Troubleshoot_FTP#Permissions above.


In case your /images directory is formated with ext3 filesystem you probably run into an issue where deleting the old image in /images/[image name] takes very long (minutes with 100GB+ images) and therefore the FTP connection times out and does not rename/move the newly uploaded image from /images/dev/[mac address] to /images/[image name]. The solution is to have your images on a different filesystem like ext4. The issue is defragmentation/reallocation in ext3. For a detailed explanation see here: http://www.depesz.com/2010/04/04/how-to-remove-backups/ HOW TO REMOVE BACKUPS?


For older versions of Ubuntu that have been upgraded to newer versions, this error could be caused by an older FTP setting that may be grandfather'ed in during the upgrade process.

This setting may be commented out or set to NO inside the settings file (see above): 

write_enable=YES

Un-comment this, and set it to YES.


NOTE: Moving images from /images/dev to /images happens during image upload. After fixing your credentials, try to re-upload and see if your image gets moved.

Images won't finish uploading, won't go past "Clearing ntfs flag"

Clearing.ntfs.flag.png

This is permissions related. See forum threads for more details:

stuck-after-clearning-ntfs-flag

imaging-stuck-on-upload-after-finished


List permissions: 

ls -laR /images

Fix permissions: Use the correct OS user, and correct storage node password to change ownership and give read/write/execute to everyone. Assumes user is "fog". 

chown fog -R /images
chmod -R 777 /images

Changing ownership with user AND group (replace "user" and "group" with actual values): 

chown user:group -R /images
Retrieved from "https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP&oldid=11119"