Job Description and Requirements
The Senior Data Engineer is responsible for improving our data architecture in order to provide reliable and quality data by collecting, managing and converting complex data sets into usable format for analysis. In order to achieve this, the role will also be accountable for designing, developing and maintaining scalable data pipelines while ensuring compliance with data governance and security policies.
Essential Functions and Responsibilities:
· Data Pipeline Development: Design, develop, and maintain scalable data pipelines.
· Data Integration: Integrate data from various sources into a unified data platform.
· Data Modeling: Develop and maintain data models to support analytics and reporting.
· Data Quality: Ensure data accuracy, consistency, and reliability.
· Performance Tuning: Optimize data processing and storage for performance.
· Collaboration: Work with cross-functional teams to understand data requirements.
· Mentorship: Provide guidance and support to junior data engineers.
· Documentation: Document data processes and workflows.
· Data Security: Implement data security measures to protect sensitive information.
· Troubleshooting: Identify and resolve data-related issues.
· Other duties as assigned (note: essential functions and responsibilities may change or new ones may be assigned at any time with or without notice).
Requirements:
· High School Diploma or GED
· Minimum of 3 years’ job-related experience
· Significant experience in designing, developing, and maintaining scalable data pipelines
· Strong background in data integration and modeling
· Proven ability to ensure data accuracy, consistency, and reliability
· Experience in optimizing data processing and storage for performance
· Familiarity with data security measures is required
· Proficiency in Python for data engineering tasks
· Strong experience with Databricks for data processing and analytics
Preferred:
· Bachelor’s degree
All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, or other legally protected status.