Job Description and Requirements
The Data Engineer II is responsible for designing, building, and maintaining the infrastructure and systems required for efficient data collection, storage, and analysis. This role involves ensuring data accessibility and availability, platform performance and cost optimization, and integrations to support data-driven decision-making processes within the organization.
Essential Functions and Responsibilities:
- Data Pipeline Development: Assist in building and maintaining data pipelines.
- Data Integration: Support data integration efforts from various sources.
- Data Transformation: Help develop transformation logic for data processing.
- Data Quality: Assist in monitoring data quality.
- Performance Optimization: Support performance tuning efforts.
- Collaboration: Work with senior data engineers to understand data requirements.
- Documentation: Assist in documenting data processes.
- Data Security: Follow data security protocols.
- Troubleshooting: Help resolve data-related issues.
- Learning and Development: Continuously improve skills and knowledge.
- Other duties as assigned (note: essential functions and responsibilities may change or new ones may be assigned at any time with or without notice).
Requirements:
- High School Diploma or GED
- Minimum of one-year job-related experience
- Experience in assisting with building and maintaining data pipelines
- Background in supporting data integration efforts and developing transformation logic for data processing
- Proven ability to assist in monitoring data quality and supporting performance tuning efforts
- Familiarity with data security protocols is required
- Proficiency in Python for data engineering tasks
- Experience with Databricks for data processing and analytics
Preferred:
- Associate’s degree
All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, or other legally protected status.