Data Engineer III

Data Engineer

We are continuing to expand and looking for more Data Engineers

Do you think in Python and speak in SQL? Do you appreciate a good data model as much as a good painting in a museum? Are you excited by an opportunity to solve complex problems while also having fun? Are you a team player? Do you strive for simplicity and elegance in your solutions? If so, MAPFRE USA is looking for a data engineer who will be part of the Data Engineering team building data products for our sophisticated data consumers. 

As a data Engineer you will be a part of an agile team delivering value. Using modern tools and technologies. You will work closely with the data architect and stakeholders and help MAPFRE USA transform to a data driven organization.

• Must be a US Citizen or a Green Card holder
• This is Hybrid schedule, onsite 3 days in the MAPFRE USA offices in Webster Massachusetts

Job Summary

• Augment and maintain the existing repositories and data structures within AWS (used to process and store large amounts of data from unrelated sources)
• Experience with several formats and means for data ingestion.  Including, data types (structured, semi-structured, and unstructured), and sources (on premise, and in the cloud) using the most appropriate techniques in each case
• Continue to expand and enhance the model, utilizing best practices, in regards to the organization of data and the various relationships
• Optimize existing and future models for fast and scalable queries (while maintaining performance and related price thresholds)
• Work with the team to define, construct, and maintain self-service dashboards for the Business and Advanced Analytics teams within PowerBI
• Implement scalable and flexible, high performance data pipelines for AWS to support analytics
• Develop and maintain data maps and their relationships
• Generate associated technical documentation including follow-up reports
• Work with Data Governance to implement quality rules and data governance measures (data dictionary, metadata, traceability, ...)
• Propose improvements and actions based on provided results
• Communicate results effectively with required teams

Knowledge, Skills and Abilities:

• Bachelor's Degree with 6+ years of experience.
• Advanced knowledge and experience using Python, Airflow, Spark, AWS, and Snowflake
• Database architectures:  SQL, NoSQL, graph databases
• CI/CD and Orchestration:  Jira, Jenkins, Bit Bucket, Terraform, and Airflow
• Past experience with data modeling tools, ETL tools (e.g. Informatica Power Center)
• Computer languages, data query and transformation tools: AWS Athena, Jupyter notebooks, Spark, Pyspark, Python, and EMR Studio
• Algorithm analysis (for working with our Data Scientists)
• Understanding of multidimensional modeling for quantitative and fact related data storage
• OS:  Linux, and MS Windows
• Code IDE:  Microsoft Visual Code, Jupyter notebooks
• Artificial intelligence, machine learning, and deep learning are a plus