Data Engineer Ii
hace 2 días
**Job Overview**:
The Data Engineer II will be part of a team responsible for designing, building, optimizing, and
pipeline builder and data wrangler who enjoys optimizing data systems and building them from
the ground up. The Data Engineer II will be responsible to ensure data consistency, integrity and
traceability while maintaining the highest level of data protection and security. The Data Engineer II must be comfortable supporting multiple teams, systems, and projects.
**Responsibilities and Duties**:
- Responsibilities:
- Analyze and organize raw data from multiple sources.
- Design, build or implement data pipelines along with supporting infrastructure.
- Create data processing architectures supporting the entire data lifecycle.
- Assemble large, complex datasets that meet functional and non-functional business
requirements.
- Prepare data for prescriptive and predictive modeling.
- Conduct complex data analysis and report on results.
- Build algorithms and prototypes.
- Build automations and repeatable patterns to improve data processing efficiency.
- Support maintenance of existing data pipelines and architectures with a view to
optimization.
- Identify opportunities for data acquisition.
- Lead and support several data efforts simultaneously.
- Understand business needs and objectives.
- Maintain strict data security controls and standards.
- Collaborate with data scientists and analytics teams.
- Work closely with all business units and engineering teams to develop strategy for long
term data platform architecture.
- Adhere to data management best practices and maintain detailed documentation.
- Qualifications:
- Proven experience building and optimizing ‘big data’ data pipelines, architectures, and
data sets.
- Strong analytic skills related to working with raw, structured, and unstructured datasets.
- Experience building and supporting processes for data transformation, data structures,
metadata, dependency, and workload management.
- A successful history of manipulating, processing, and extracting value from datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’
data stores.
- 5+ years in data engineering experience.
- Project management experience and able to work closely with project managers.
- Experience including design and build with ETL, ELT tools and workflows.
- Experience including design and build with scripting in a data engineering context (Python
experience a plus).
- Experience including design and build with common database technologies including SQL,
NoSQL, Parquet.
- Experience including design and build with cloud-based database and data pipeline
technologies (Azure experience a plus).
- Experience with version control and dev ops pipelines.
**Education Requirements**:
Bachelor’s Degree
**Experience Requirements**:
3+ years
**About OnProcess**
- OnProcess is on a mission - to transform and drive the world’s circular service supply chains - for brilliant customer experiences, efficiencies at the speed of digital, and more sustainable ‘circular economy’ processes.
At OnProcess, we encourage a collective sense of engagement, affirmation and belonging, where everyone is proud to be a member of our company. As a global business, we recognize our ability to understand, embrace and operate in a multicultural world - both in the marketplace and in the workplace - is critical to our long-term sustainability. That’s why we are committed to a company-wide culture that understands that diversity, equity, and inclusion is essential.
-
Manufacturing Engineer Ii
hace 7 días
Antofagasta, Chile Monteris Medical A tiempo completoThis employer uses E-Verify. This role is to provide engineering support for development and manufacture of disposable and capital medical devices design by Monteris Medical. Activities include direct production line support, investigations and problem solving, cost savings and operational control improvements, design transfer and production setup of new...
-
Investigation Specialist I/ii
hace 2 semanas
Antofagasta, Chile Kentucky Lottery Corporation A tiempo completo**DEPARTMENT**: - Sales**REPORTS TO**: - Regional Sales Manager, Eastern Region**LOCATION**: - Field Sales**JOB SUMMARY** The Investigation Specialist I/II provides administrative support and assistance to the Kentucky Lottery Corporation (KLC) employees, retailers, law enforcement, and members of the general public in security related matters. Reviews...
-
Work From Home Python Engineer
hace 1 semana
Antofagasta, Chile BairesDev LLC A tiempo completoAt BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide. Python Engineer at...
-
Instrument Engineer
hace 7 días
Antofagasta, Chile LHR Arabia A tiempo completoWe are seeking a **Instrument Engineer** with knowledge in economic principles, engineering codes, standards, and specifications, with 3 years of relevant work experience in oil & petrochemical industry. **OUR CLIENT** Our client is a world leading Refinery & Petrochemical Company located in Rabigh. By adding value to the nation’s key resources, they are...
-
QA Engineer
hace 12 horas
Antofagasta, Chile Flowserve Corporation A tiempo completo**Role Summary**: **As a QA Engineer, you will support in the development, implementation and running of quality control programs and procedures. This position involves the translation of customer specifications and industry standards into product / process criteria and creating control plans to achieve those requirements. You’ll also address the...
-
Performance Monitoring Engineer
hace 7 días
Antofagasta, Chile LHR Arabia A tiempo completoWe are seeking a **Performance Monitoring **Engineer **to provide experience in products accounting within a hydrocarbon accounting model. **OUR CLIENT** Our client is a world leading Refinery & Petrochemical Company located in Rabigh. By adding value to the nation’s key resources, they are attracting diverse new industries and creating jobs, enriching...
-
Cost Estimator Engineer
hace 7 días
Antofagasta, Chile LHR Arabia A tiempo completoWe are seeking a **Cost Estimator **Engineer **to provide experience in cost estimating for construction projects. **OUR CLIENT** Our client is a world leading Refinery & Petrochemical Company located in Rabigh. By adding value to the nation’s key resources, they are attracting diverse new industries and creating jobs, enriching life for everyone by...
-
Mechanical Engineer
hace 7 días
Antofagasta, Chile LHR Arabia A tiempo completoWe are seeking a **Mechanical Engineer** **experienced in refining and/or petrochemical industry piping and equipment design and plant trouble shooting, with minimum 3 years of experience in relevant field. To provide direction for the preparation of designs, processes and related data for very complex engineering problems to ensure that work is completed as...
-
Territory Sales Manager I/ii
hace 1 semana
Antofagasta, Chile Kentucky Lottery Corporation A tiempo completo**DEPARTMENT**: - Sales**REPORTS TO**: - Regional Sales Manager**LOCATION** - Jefferson Region**JOB SUMMARY** The Territory Sales Manager sells, manages, markets, and promotes lottery products at retail locations to maximize revenues over time. Maintains and manages territorial retailer account base. Responsible for the revenue, profitability, development,...
-
Ics Cybersecurity Engineer
hace 7 días
Antofagasta, Chile LHR Arabia A tiempo completoWe are seeking an **ICS Cybersecurity Engineer **to ensure that the organization’s cybersecurity program complies with applicable requirements, policies, and standards. Assists in creating policies and procedures to help reduce risk, meet regulatory requirements, and best business practices. Develop awareness materials and phishing test scenarios. **OUR...