Prophecy provides low-code data engineering to visually build and deploy data pipelines on Apache Spark. Prophecy is based on git and replaces traditional ETL and data integration products.
Overview
Prophecy provides an easy to use visual interface to design and run data pipelines at scale.
- Prophecy is a complete product that provides visual development for Spark/ Databricks, visual scheduling on Airflow, and metadata management with search and column-level lineage.
- Prophecy generates code on git, tests and enables CI/CD bringing software engineering best practices to building data pipelines.
- Prophecy is extensible - users can add new visual components by writing Spark code templates
- Prophecy works with large scale and very complex workloads
- Prophecy enables a wide set of data users to build data pipelines on Spark. Prophecy also replaces ETL products as organizations migrate from legacy on-premises to the cloud.
- Prophecy runs within your network
Highlights
- ETL
- Data Engineering
- Data Integration
Details
Sold by
Categories
Delivery method
Delivery option
Helm Chart
Latest version
Operating system
Linux
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Dimension | Cost/user/hour |
|---|---|
Cost(minimum: 10 users) | $0.833 |
Vendor refund policy
This is a placeholder value. Please update this value via the AWS Marketplace Management Portal.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Helm Chart
Supported services: Learn more
- Amazon EKS
Helm chart
Helm charts are Kubernetes YAML manifests combined into a single package that can be installed on Kubernetes clusters. The containerized application is deployed on a cluster by running a single Helm install command to install the seller-provided Helm chart.
Version release notes
Use Prophecy's base domain(prophecy.io) and certificates. Your certificates will be issued by letsencrypt
Additional details
Usage instructions
Product install instructions are available at: https://github.com/SimpleDataLabsInc/prophecy-on-public-cloud/blob/main/aws/marketplace/install.md
Resources
Vendor resources
Support
Vendor support
Email: support@prophecy.io Slack:
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Prophecy: Machine Learning and Time Series Forecasting Implementation
By People Tech Group
Delivering solutions for Time Series forecasting, classification, and other machine learning models. Developing tools to help deploy, monitor and manage complex models through AWS.
Customer reviews
Gaurav M.
Prohecy - The best no code etl product
Reviewed on May 14, 2024
Review provided by G2
What do you like best about the product?
I really like the niche and elegant ui of prohecy, via prohecy we can connect the dots between various soruces and destination, it provides a various number of transformation like join,split, api enrichment etc.. Apart from this,I really like the logging feature as well. It's column lineage feature set it apart from other etl platform
What do you dislike about the product?
Sometimes it is difficult to identify root cause of pipeline feature due to sudded restarts loop of a job, so we need to deep dive into pipeline logs to find it. Also some topics in documentation can have more real life examples to enable user to use and apply them in the pipeline
What problems is the product solving and how is that benefiting you?
With prophecy and databrick integration, we are able to schedule 1k+ databricks jobs using prophecy scheduler. Our jobs consists of bronze to silver etl, qc jobs, gold flatten jobs and some realtime spark streaming jobs as well. With prohecy we are able to properly utilize databricks resource. It provides a lot of insights of data using custom transformation which enable our downstream team to quickly research on user trend on our platform which ultimately increase user churn rate on our platform
Leave a comment0 comments
Information Technology and Services
Prophecy Feedback
Reviewed on Mar 07, 2024
Review provided by G2
What do you like best about the product?
It provides easy to use visual editor, It generates open source format code, No vednor lockin, Automated release management.
What do you dislike about the product?
It doesnt works with Serverless spark clusters yet.
What problems is the product solving and how is that benefiting you?
Prophecy visual editor makes it very easy to write ETL jobs and test them.
Insurance
less code and user friendly
Reviewed on Dec 22, 2023
Review provided by G2
What do you like best about the product?
good tool for begineers in programming.
What do you dislike about the product?
recommendations in programming can be improved.
What problems is the product solving and how is that benefiting you?
Abinitio migration to open source Spark.
Insurance
Building ETL pipelines made effortless
Reviewed on Dec 18, 2023
Review provided by G2
What do you like best about the product?
Automatically generating code without writing any code manually.
What do you dislike about the product?
In terms of connecting inputs for join it's difficult to understand which datasets are connecting.
The syntax for prophecy is difficult comoared to scala syntax.
The syntax for prophecy is difficult comoared to scala syntax.
What problems is the product solving and how is that benefiting you?
Converting ab initio code into scala/spark code.
Pavan K.
Best Abinitio to Spark Migration tool in the market
Reviewed on Dec 05, 2023
Review provided by G2
What do you like best about the product?
Best UI Experience
Best Support Team
High quality generated code
Best Support Team
High quality generated code
What do you dislike about the product?
Debugging is difficult sometimes
some amount of learning is required to use this product
some amount of learning is required to use this product
What problems is the product solving and how is that benefiting you?
Migrating Abinitio code to Spark code