I have experience in data transformations using Python, putting and getting objects from Amazon S3, and inserting and read data into MySQL and other databases, using Python. I have not used Redshift yet, but I have a lot of experience using Python to send data to MySQL. I have an AWS account that I can use for some testing, and I'm setting up a free-tier Redshift trial.
Relevant Skills and Experience
Python, Amazon Web Services S3, MySQL, other databases.
What I need to start:
Sample file.
Description of transformations. If there are "simple" and "complex" transformations, please group them so that I can start with the simple ones as a proof of concept.
Redshift database schema.
Proposed Milestones
$50 USD - Read S3 file, transform 1 object up to 5 fields with simple transforms, insert into Redshift
$105 USD - Complete rest of project
Additional Services Offered
$50 USD - Notification to SNS of job status
Questions:
Has the Redshift database been set up?
Will the code run as Lambda function or on-demand? The Lambda function can be triggered by object add to S3 bucket.
Python 2.7 or Python 3, or does it matter?
Is there a way for me to use your AWS resources for development, or do I need to develop on my AWS account?