AWS Data Engineering Specialist
Pittsburgh, PA - On site
Skills: AWS, ETL, CI/CD, Docker, Terraform, Devops
Job Description
Extensive experience with AWS services: EMR, S3, Redshift, Glue, Lambda, Step Functions, DynamoDB, RDS, Athena, EventBridge, API Gateway, and SNS.
Expert in ETL concepts, with a strong background in AWS Glue and data pipeline orchestration.
Strong experience with PySpark and Kafka for building data streams and batch processing systems.
In-depth knowledge of data partitioning and Parquet files for efficient data storage and querying.
Strong experience with SQL, including writing complex queries, and working with databases like Redshift and Snowflake.
Proficiency in DevOps concepts, with hands-on experience in CI/CD pipelines, Docker, and Terraform.
Excellent understanding of data lake, data warehouse, and data lake house concepts.
Proven experience leading teams, mentoring engineers, and managing end-to-end technical implementations.
Experience working with Redshift Spectrum and Athena for querying large-scale data.
Understanding of security best practices for cloud data solutions, including IAM roles and policies.
Familiarity with data governance, compliance, and data quality frameworks.
Must Have
Proficiency in SQL/NoSQL and database systems (DB2, SQL Server, Snowflake, MongoDB).
Experience with ETL tools (Informatica, IICS, Talend, SSIS, Apache Airflow).
Knowledge of scripting languages (Python, Bash, Py-Spark).
Understanding of cloud data platforms like AWS Glue, S3.
Understanding of file format like JSON, Apache Parquet.
Familiarity with big data technologies (Spark, Hadoop, Kafka).
Nice to Have (Senior Roles)
Experience with real-time data processing.
Certifications in ETL tools or cloud platforms.
...assembly? We're looking for a Touch-Up/Rework Operator to join our dynamic team in Milpitas, CA!... ...and are ready to put your skills to work on cutting-edge products, we want to hear... ...manufacturing. I'm currently scheduling 15-minute phone interviews with candidates interested in...
Seasonal Shoe StylistOverview:This position is responsible for applying selling techniques to merchandise, developing a client base to build sales, and achieve store profit objectives.Major Qualifications (include but are not limited to):* Ensure that...
...of a mission. Youll have the tools, the training, and the support to build a business within a business, all while making a difference. Apply now if you're ready to bet on yourselfand win. No experience? No problem. We hire for attitude and train for skill....
...Ensure timely and accurate movement of freight and information, while providing exceptional... ...'s degree preferred. ~6 months experience in Ocean Import ~ Effective interpersonal... ...Reporting Structure ~ Ocean Import Lead Agent, Supervisor and Manager...
...Were looking for a creative and detail-oriented Front-End Web Developer to join our team. You'll help build and maintain engaging websites,... ...some! Javascript experience is a plus. You will use some Alpine.js Location: Remote Employment Type: Full-time...