AWS Data Exchange for AWS Lake Formation (Preview)
Accelerate time to insights with third-party data directly in your data lake
AWS Data Exchange for AWS Lake Formation helps data providers to license access to live, ready-to-use structured tables through Lake Formation. Subscribers can immediately query and analyze the data with any other Lake Formation-compatible query engine, including Amazon Redshift Spectrum and Amazon Athena. This reduces the time data engineering teams spend on extract, transform, load (ETL) processes, driving faster time to insight for downstream data consumers.
Key benefits for data subscribers
Faster time to third-party data access
Query Lake Formation data permission datasets through Amazon Athena or Amazon Redshift Spectrum without any ETL.
Govern third-party data alongside first-party data
Activate fine-grained permissions on third-party data to securely manage access to your acquired data.
Reduce data duplication
Lake Formation data permission datasets appear in your Lake Formation and AWS Glue Catalog, which means you have a comprehensive, discoverable Data Catalog for your third-party data.
How AWS Data Exchange works for AWS Lake Formation
- The diagram shows how data subscribers get access to and use AWS Data Exchange for AWS Lake Formation. Six written step and six illustrations display from left to right.
- The first step says, “Third-party” data. The first illustration is a database stack that represents a data set owned by a third-party data provider.
- The second step is titled “AWS Lake Formation”. A text description says, “Data providers add LF-tags to the resources they want to license”. The second illustration is a funnel overlapping a circle with wavey lines inside it that represents data being added to a data lake.
- The third step is titled “AWS Data Exchange”. A text description says, “Data providers curate and publish data products via AWS Data Exchange”. The third illustration is of an overlapping circle and square that represents data being exchanged.
- The fourth step is titled “AWS Marketplace”. A text description says, “Customers subscribe to data products from AWS Marketplace”. The fourth illustration is of a shopping cart with squares inside of it that represents a customer shopping on AWS Marketplace.
- The fifth step is titled “AWS Lake Formation”. A text description says, “Data lake administrators manage entitled data in their data lake alongside first-party data”. The fifth illustration is a funnel overlapping a circle with wavey lines inside it that represent data being added to a data lake.
- The sixth step is titled “Amazon Athena”. A text description says, “End users query the data from analytics services like Amazon Athena”. The fifth illustration is a magnifying glass with a bucket in the middle of the circle that represents analyzing data using Amazon Athena.
Use cases
Enterprise customers
Your data consumers don’t need to wait for data engineering to cleanse, validate, parse, and transform files into tables. As soon as a subscription is live, Lake Formation admins can share access with the appropriate teams, who can query using any Lake Formation-supported query engine like Amazon Athena. Data made available through Lake Formation data permission datasets automatically appears in your AWS Glue Data Catalog alongside your first-party tables. This helps you create a comprehensive, discoverable Data Catalog across your first- and third-party data.
Third-party data providers
AWS Data Exchange for Lake Formation streamlines data sharing operations, reducing time and money spent on redundant tasks across customers. Your data lake admins tag your databases, tables, or columns with the appropriate LF-tags and add those tags to a dataset on AWS Data Exchange. The data associated with those LF-tags is available to subscribers. This feature can help differentiate your data, as data in Lake Formation is delivered in a ready-to-use format that removes the undifferentiated heavy lifting from your customers.
Let us help you find the data you need
Speak with an AWS Data Exchange expert who can help you find the solutions you need to make smarter decisions.
AWS Data Exchange learning resources
This innovative resource is designed as a broad compilation of use cases submitted by AWS Marketplace data providers. Each contributor tells a concise but unique story of how they solved a particular business challenge through a reliable third-party data solution.
Connect with AWS Data Exchange
