Data Engineer( Python + AWS)

Job responsibilities

• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Develops secure high-quality production code, and reviews and debugs code written by others
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
• Design and develop data pipelines to ingest, store, and process data from multiple sources
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
• Contributes to software engineering communities of practice and events that explore new and emerging technologies
• Adds to team culture of diversity, equity, inclusion, and respect

Required qualifications, capabilities, and skills

• Formal training or certification on data engineering concepts and 3+ years of applied experience
• Practical Experience in one or more programming language(s), such as Python, Java
• Experience with SQL-based technologies (e.g., MySQL/ Oracle DB)
• Hands-on practical experience delivering data pipelines
• Proficient in all aspects of the Software Development Life Cycle
• Understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security
• Demonstrated proficiency and experience with cloud-native distributed systems
• Ability to develop reports, dashboards, and processes to continuously monitor data quality and integrity
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
• Experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
• Working knowledge of bitbucket and JIRA