Overview
This is a repackaged open-source software product wherein additional charges apply for technical support and maintenance by Apps4Rent.
Llama 2 is part of a series of advanced language models developed by Meta, with this variant harnessing 13 billion parameters. It has been specifically fine-tuned for dialogue use cases, offering a step-up in capabilities compared to generic language models. Gradio is the fastest way to demo your machine learning model with a friendly web interface so that anyone can use it, anywhere. Gradio allows you to build demos and share them, all in Python. And usually in just a few lines of code.
Disclaimer: The respective trademarks mentioned in the offering are owned by the respective companies. We do not provide the commercial license of any of these products. Many of the products have a free, demo or Open-Source license as applicable. Image may take up to 5-7 minutes for initial launch.
Highlights
- Apps4Rent provides Llama2-13B-Chat and Gradio which is ready to use for Production Environment.
- Apps4Rent is offering "Pack of 2 product" (2 software's on a single machine) at an affordable price point of USD 0.1/hour (any vCPU).
- For any custom build AMI's of your choice contact us on "support@apps4rent.com"
Details
Typical total price
$0.292/hour
Pricing
- ...
Instance type | Product cost/hour | EC2 cost/hour | Total/hour |
|---|---|---|---|
t1.micro | $0.10 | $0.02 | $0.12 |
t2.nano | $0.10 | $0.006 | $0.106 |
t2.micro AWS Free Tier | $0.10 | $0.012 | $0.112 |
t2.small | $0.10 | $0.023 | $0.123 |
t2.medium | $0.10 | $0.046 | $0.146 |
t2.large | $0.10 | $0.093 | $0.193 |
t2.xlarge | $0.10 | $0.186 | $0.286 |
t2.2xlarge | $0.10 | $0.371 | $0.471 |
t3.nano | $0.10 | $0.005 | $0.105 |
t3.micro AWS Free Tier | $0.10 | $0.01 | $0.11 |
Additional AWS infrastructure costs
Type | Cost |
|---|---|
EBS General Purpose SSD (gp2) volumes | $0.10/per GB/month of provisioned storage |
Vendor refund policy
Apps4Rent does not offer commercial licenses of any of the products mentioned above. The products come with open-source licenses.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Llama2-13b-chat: https://huggingface.co/meta-llama/Llama-2-13b-chat ,
Gradio release note: https://github.com/gradio-app/gradio/releases
Additional details
Usage instructions
*Connect to your Linux instance via port no. 22 using SSH. *Please refer this article: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AccessingInstancesLinux.html
- Sign-in credentials: Username: ubuntu
*To see the Llama2-13b-chat installed directories, follow the commands: i)Get access to the machine using SSH. ii)Become a super user: sudo su iii)Locate the installed Llama2-13b-chat directory: cd llama iv)To list down the files inside Llama directory: ls v)To see the hidden Files as well: ls -la
*Dependencies Version check: i)Git version: git --version (2.25.1) ii)Python version: python3 --version (3.11.3) iii)Conda version: conda --version (23.5.2)
*Following are the steps to verify the version as well as installation of Gradio: Step i) Once you are logged into the instance, update the instance with sudo apt-get update. Step ii) Next run, source my-env/bin/activate. The given command is for activating the virtual environment 'my-env' created to install Gradio. Step iii) Run the command below inside the my-env: pip show gradio Step iv) To exit from the my-env, type deactivate and enter.
*Below are the minimum external resources subscriber needs to have to use this product: i) An Internet Connection is required for this product to function as expected. ii)We recommend keeping your crucial data in a custom made encrypted EBS to save it from termination in future.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
