08
Tue, Oct
2 New Articles

What's Hot: Secure File Transfers on IBM i. What's Not: FTP

IBM i (OS/400, i5/OS)
Typography
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

Organizations must rethink how file transfers are secured and controlled within the organization.

 

Every day, millions of files are transmitted around the world by corporations, government, and other organizations. These electronic transfers include the critical data needed to conduct business, such as customer and order information, EDI documents, financial data, payment information, as well as employee and healthcare information.

 

File Transfer Protocol (FTP) has been used for decades to transmit vital information, but this popular protocol has serious security risks that should not be ignored.

 

History of FTP

When FTP was introduced in the '70s, the public Internet did not exist and information security was an immature science. FTP was initially used within private networks or over dedicated lines to trading partners, so it was considered a relatively safe way to move files.

 

Over the last several years, most organizations have migrated a bulk of their file transfers to the public Internet to take advantage of its cheap bandwidth. But even though the Internet is much more vulnerable to attacks than private lines, many have continued to use FTP because it's familiar and embedded within their legacy applications.

 

The FTP specifications have retained their basic structure and functionality over the decades. And because it has not evolved, FTP is a protocol that is rife with security exposures and management issues for the modern enterprise.

 

062215LuebbeFigure 1 - Standard FTP - Luebbe

Figure 1: Standard FTP is vulnerable to attacks.

 

Everything that flows over a standard FTP connection is in "the clear," meaning that a would-be attacker can simply sit on the network or router and watch all of the user IDs, passwords, and data that are transmitted over the FTP connection. The attacker can not only capture this information easily with readily available "packet sniffing" tools, but also manipulate this data since FTP does nothing to protect its integrity.

 

FTP Costs and Compliance Issues

A loss of sensitive data can be very expensive for your organization. Besides the direct costs associated with an exposure, your organization can lose goodwill and trust from your customers if you cannot properly protect their information. Depending on the extent of the FTP breach, the combination of direct and indirect costs (due to lost business) could easily reach millions of dollars.

 

Organizations should look for alternatives to unsecure FTP to also get in compliance with data security regulations such as PCI DSS, HIPAA, and state privacy laws. Many of these regulations require that sensitive data is encrypted if it's transmitted over the Internet, which standard FTP does not offer.

 

Non-compliance can result in significant fines and penalties for organizations. For instance, an organization could lose its ability to accept credit card payments if it does not comply with PCI DSS requirements.

 

With the competitive global marketplace and increased scrutiny, companies simply cannot afford the risks associated with using standard unsecure FTP.

 

Secure FTP

One of the best solutions for protecting your FTP transmissions is to upgrade to "Secure FTP" encryption technology. The two mainstream protocols available for Secure FTP transfers are SFTP (meaning FTP over SSH) and FTPS (meaning FTP over SSL). 

 

Both SFTP and FTPS offer a high level of protection because they create encrypted tunnels between your system and your trading partners. In essence, anything that flows over those tunnels will be encrypted, including any files, user IDs, passwords, and commands.

 

Both SFTP and FTPS support a wide variety of functionality with a broad command set for transferring and working with files. The most notable difference between SFTP and FTPS is how connections are authenticated and managed.

 

SFTP

With SFTP, a connection can be authenticated using a couple different techniques. For basic authentication, you (or your trading partner) may just require a user ID and password to connect to the SFTP server. Remember, any user IDs and passwords supplied over the SFTP connection will be encrypted, which is a big advantage over standard FTP.

 

SSH keys can also be used to authenticate SFTP connections in addition to, or instead of, passwords. With key-based authentication, you will need to generate the SSH private key and public key beforehand. If you need to connect to a trading partner's SFTP server, you send your SSH public key to them, which they will load onto their server and associate with your account. 

 

062215LuebbeFigure 2 - SFTP - Luebbe

Figure 2: SFTP provides an encrypted tunnel and key authentication.

 

 

When you connect to your partner's SFTP server, your client software will transmit your public key to the server for authentication. If the keys match, along with any user ID/password supplied, then the authentication will succeed.

 

FTPS

With FTPS, a connection is authenticated using a user ID, password, and certificate(s). As with SFTP, the user IDs and passwords for FTPS connections will be encrypted. When connecting to a trading partner's FTPS server, your FTPS client will first check whether the server's certificate is trusted. 

 

The certificate is considered trusted if either the certificate was signed off by a known Certificate Authority (CA), like Verisign, or the certificate was self-signed (by your partner) and you have a copy of their public certificate in your trusted key store.

 

062215LuebbeFigure 3 - FTPS - Luebbe

Figure 3: FTPS alternatively provides certificate-based authentication.

 

Your partner may also require that you supply a certificate when you connect to them. Your certificate may be signed off by a third-party CA, or your partner may allow you to just self-sign your certificate, as long as you send them the public portion of your certificate beforehand (which they will load in their trusted key store).

 

SFTP or FTPS: Which to Choose?

SFTP only needs a single port number (default of 22) to be opened through the firewall. This port will be used for all SFTP communications, including the initial authentication, any commands issued, as well as any data transferred.

 

On the other hand, FTPS can be very difficult to patch through a tightly secured firewall since FTPS uses multiple port numbers. The initial port number (default of 21) is used for authentication and passing any commands. However, every time a file transfer request (get, put) or directory listing request is made, another port number needs to be opened. You and your trading partners will therefore have to open a range of ports in your firewalls to allow for FTPS connections, which can be a security risk for your network.

 

SFTP and FTPS are both very secure, providing strong authentication options. However, since SFTP is much easier to port through firewalls, and we are seeing an increasing percentage of trading partners adopting SFTP, I believe SFTP is the clear winner for your secure FTP needs.

 

Moving Away from Unsecure FTP

The first step of moving away from standard FTP is to investigate how it is being used in your organization. For instance:

 

  • What kinds of data do you send or retrieve over FTP?
  • Where do the FTP client applications reside?
  • Where are FTP scripts being used?

The answers to these and other questions will help you understand the breadth of the security problems facing your organization with FTP.

 

Network monitoring tools can find unsecure FTP traffic that is flowing within and out of your organization. These tools will track the FTP origination to a source IP address in your network. From there, you will have to do more investigation to find the actual FTP scripts or tools.

 

A more drastic approach is to block FTP traffic at the firewall level and then wait and "see what happens." While this will solve the FTP security issue, your trading partners may not get their files, and business operations may be disrupted. Blocking FTP traffic should be implemented only after you believe all existing FTP scripts and tools have been converted to alternative secure approaches.

 

Implementing Secure FTP on IBM i

Secure FTP can be implemented on IBM i by using either free utilities or a third-party commercial product.

 

If you want to go with the free approach for FTPS, you can import your trading partner's public certificate and start the FTP connection with the SECCNN keywords of *SSL or *IMPLICIT. You can then continue to use existing FTP scripts over the SSL connection. Note that additional ports will probably have to be opened in the firewall for the FTPS control and data channels.

 

For the free SFTP implementation, you will need to use IBM's OpenSSH utilities and PASE to create the SSH keys and perform the SFTP transfers. There are quite a number of cryptic steps to get everything set up initially, and these steps must be followed precisely for the SFTP connection to work. You will also have to create new programs to automate any transfers because SFTP will not recognize your current FTP scripts.

 

When using the free Secure FTP utilities, you will also have to do programming to trap for errors and to generate alerts when problems arise. This is very important: you don't want to have to wait for your trading partner to call and tell you that they did not receive the file.

 

It is generally easier to use a commercial solution to set up Secure FTP on the IBM i since programming is usually not required to set up the transfers. Commercial products also provide advanced features like auto-resume and packet integrity checks to help guarantee delivery. They have built-in alerts that can be sent by email or system messages when transfers fail. Commercial products also provide integrated audit trails and reporting to meet strict compliance requirements like those of PCI DSS.

 

Other Options to Secure FTP

There are several other alternatives to the SFTP and FTPS protocols, including these:

  • AS2
  • HTTPS
  • Open PGP
  • ZIP with AES encryption

While these are all viable approaches for protecting sensitive data, they are not as easy to implement as Secure FTP on the IBM i, unless you are using a commercial solution.

 

The secure protocol that you use will be dependent on your trading partner's capabilities. For instance, most banks and financial institutions support SFTP for secure transmissions but may not support FTPS. And if you are in manufacturing or distribution, many retailers (e.g., Walmart) require AS2 protocol for transmitting orders securely.

 

The Next Level: Managed File Transfer (MFT)

Typically, standalone FTP tools and scripts are scattered throughout the organization. End users will use PC tools like Filezilla to perform manual FTP transfers, the network team is using Windows and Linux shell FTP scripts, and the IBM i team has built their own CL-based FTP scripts.

 

This decentralization of file transfers has made it very difficult to control and track the movement of files that are leaving the organization. Compliance and auditing requirements are forcing organizations to rethink their file transfer strategy.

 

The solution that is gaining popularity is called Managed File Transfer (MFT), which centralizes all file transfers under one umbrella. MFT solutions provide support for a wide range of secure standards, including SFTP, FTPS, SCP, Open PGP, AS2, and ZIP with AES encryption. Transfers can be scheduled or can be triggered by the presence of a file in MFT solutions.

 

062215LuebbeFigure 4 - MFT - Luebbe

Figure 4: Managed File Transfer offers centralized control and auditing.

 

 

MFT solutions were built not only to simplify and centralize file transfers, but also to help companies report on where files are being transferred and by whom for compliance purposes.

 

Controlling the FTP Exposure

As a file transfer mechanism, FTP has had a long history. But the inherently weak security of its basic design has left organizations with serious security hazards. IT must therefore bring their file transfers into compliance by using secure protocols like SFTP and FTPS.

 

Finally, organizations must rethink how file transfers are controlled within the organization. They should consider a Managed File Transfer solution to accommodate their growing trading partner base, while centralizing these file transfers under "one pane of glass" for compliance and reporting.

 

Bob Luebbe

Bob Luebbe is Chief Architect at Linoma Software (www.linomasoftware.com) and has spent nearly 30 years in IT with the last decade focused on developing encryption technologies and managed file transfer solutions. Bob also consults with organizations on achieving regulatory compliance in data protection.

BLOG COMMENTS POWERED BY DISQUS

LATEST COMMENTS

Support MC Press Online

$

Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: