Globus Transfer service
Research applications often require sophisticated data management capabilities, for example to move large amounts of data between acquisition, storage, analysis and archival. However, doing so efficiently and reliably is often a difficult undertaking, requiring significant expertise to maximize available bandwidth, restart transfers that fail (due to network unreliability), validate that files have been transferred correctly, and securely transfer data between resources with different security configurations. Globus Transfer addresses these challenges by providing an easy to use “fire-and forget” data transfer mechanism that can be integrated by developers into their own applications.
Globus Transfer provides high performance, secure, third-party data movement and synchronization between endpoints, as well as in-place sharing of files directly on existing storage systems. Globus Transfer handles all the difficult aspects of data transfer, allowing application users to easily start and manage transfers between endpoints, while automatically tuning parameters to maximize bandwidth usage, managing security configurations, providing automatic fault recovery, and notifying users of completion and problems. With in-place sharing of data, researchers can share large datasets directly from their existing storage repositories on which the data resides.
Developers can leverage Globus Transfer to provide a high-performance and reliable upload or download mechanism for large (or small) datasets. This allows application users to asynchronously start uploads or downloads and rely on Globus Transfer to ensure the data is moved efficiently and reliably. By integrating Globus Transfer into an application, developers gain access to the over 50,000 Globus storage endpoints that are active each year.
Explore Globus Transfer
- Use the Globus Transfer API Overview to get started.
- See how to access the service via the Globus Python SDK.
- Experiment with the platform via Jupyter notebooks.
- Globus Transfer API Reference.
- Read our paper describing the design and implementation of Globus Transfer.
- The Modern Research Data Portal, a proven design pattern for providing secure, scalable, and high performance access to research data, is built using Globus platform services.