AWS Data Exchange for Amazon S3
Directly access and use data providers’ Amazon S3 data
AWS Data Exchange for Amazon S3 overview
AWS Data Exchange data subscribers can now easily find, subscribe to, and use third-party files directly from data providers’ Amazon Simple Storage Service (Amazon S3) buckets. Data subscribers access the same copy of the S3 object that the data provider maintains and are therefore always using the most up-to-date data. This results in faster time-to-insights for analysis since data subscribers no longer need to create or manage copies of S3 objects in their own environment. And because subscribers use the same data files as data providers, no additional engineering or operational work is needed by data subscribers to stay up-to-date.
Key benefits for data subscribers
Once subscribed, you can use the provider’s data anywhere you’d use an Amazon S3 bucket name to access data in S3.
Start your analysis without having to set up your own S3 buckets, copy data files into those S3 buckets, or pay associated storage fees.
Simple management of data licensing
Access to the provider’s S3 bucket is automatically granted when you subscribe and automatically revoked when the subscription ends.
Automatic updates
By accessing the same S3 objects that the data provider maintains, you always use the most up-to-date data available, without additional engineering or operational work.
How AWS Data Exchange works for Amazon S3
The diagram shows how data providers set-up access to and use AWS Data Exchange for data files.
- The first step: Data provider “Set up access on top of the data provider's Amason S3 buckets”.
- Shared S3 objects can be server-side encrypted with customer managed keys stored in AWS Key Management System (KMS) or with Amazon S3 managed keys.
- The second step: In the AWS Marketplace, subscribers can "Find, subscribe to, and use third-party files without needing to dreate or manage copies".
- The third step shows features of AWS Data Exchange for Amazon S3
- Share one data copy
- Use the most current data offered
- Automoate billing and payments
- Manage file, table and API data sets in one place
- The fourth step shows a data subscriber having "Access in one place". "Subscribers start data analyses and use the providers data directly."
- Compatible AWS Services:
- Amazon Athena
- Amazon SageMaker Feature Store
- Amazon EMR
- Amazon S3
Customer success
AWS Data Exchange for Amazon S3 makes it effortless for Rearc to deliver large and constantly changing Finance and Healthcare datasets to our customers. We no longer need to duplicate our data across buckets, and updates are instantaneous, giving our subscribers an even better customer experience.
Milin Patel, Co-Founder & Principal Architect - Rearc
Ovation’s mission is to get high-quality, consented, and representative clinicogenomic data into the hands of life sciences organizations at scale. To achieve our purpose, we must ensure researchers can access our data quickly and efficiently. That’s why we’re excited to use AWS Data Exchange for Amazon S3 to enable our life sciences partners to access our genomic datasets in just a few steps. Delivering our data directly via AWS Data Exchange for Amazon S3 improves the time to value of our genomic datasets while reducing costs for Ovation and our partners.
Curt Medeiros, Chief Executive Officer - Ovation
Vexcel operates the world’s largest aerial imagery and geospatial information program. We store petabytes of imagery in AWS and publish roughly 100,000 new images every day. And now with AWS Data Exchange for Amazon S3, we can better leverage subscription management, entitlement, and billing capabilities to a broader segment of customers who need up-to-date data. This will also help further streamline our operational costs and engineering effort.
Rob Agee, COO - Vexcel Data Program
AWS Data Exchange resources
Connect with AWS Data Exchange
