Overview
SmartLoader is an ETL Component designed to simplify the loading of CSV files into a database. It has advanced capabilities that includes analyzing the input file(s) structure and generating corresponding configuration scripts to be used for loading the data into a database. It supports reading compressed and uncompressed files. It also supports the Groovy scripting language that lets you implement a wide range of data transformations. It is a must-have in environments that require FAST and SCALABLE loading of CSV files.
Key Features:
- Parsing and loading of plain CSV files into a database
- Automatic creation of destination table if it does not exist
- Auditing of loaded files via generating detailed data loading logs
- Automatic archiving loaded files
- Identification and placement of rejected files into a separate folder
- Advanced file parsing capability for files with same content but different filenames
- Setting of data loading speed
- Support for Groovy scripting language for advanced data transformations
- Support for data loading into Vertica and MySQL databases (support for additional databases being added)
- Run component as needed or schedule it for regular execution intervals
Highlights
- Efficient data integration tool designed for parsing and loading of flat compressed and uncompressed data files into Vertica and MySQL databases. It makes efficient use of CPU and memory resources and it is fast and highly scalable. Advanced users can use the Groovy language to extend its data transformation capabilities
- Automatic sensing of input data file structures and automatic creation of destination tables. it will automatically generate needed configuration files to properly ingest the data.
- Advanced file management where input files are automatically archived or flagged in case of parsing errors. It also provides detailed logging for troubleshooting and monitoring purposes.
Details
Pricing
Dimension | Description | Cost/unit/hour |
|---|---|---|
Hours | Container Hours | $4.90 |
Vendor refund policy
This is a placeholder value. Please update this value via the AWS Marketplace Management Portal.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Docker Container
- Amazon ECS
- Amazon EKS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
Initial Release
Additional details
Usage instructions
Please refer to the ECS and EKS documentation for instructions on how to create ECS tasks and EKS pods and launch the SmartLoader container. It is important to have the appropriate IAM role and a policy that can access "aws-marketplace:RegisterUsage".
SmartLoader requires the definition of a working directory that needs to be set. Please refer to the SmartLoader Getting Started section in the online documentation on how to configure and set the working directory.
Database access credentials can be defined in AWS AppConfig and accessed via SmartLoader's command line argument dbUser and dbPassword keys.
Resources
Vendor resources
Support
Vendor support
Inovvo provides support via email. All support inquiries will be answered as soon as possible. Please send all support inquiries to support@inovvo.com
In order to provide you with the best support, please include the following information in your support inquiry:
Detailed description of the issue Copy of the source file(s) being imported (please remove any sensitive or personally identifiable information from the shared file(s)) Configuration files
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.