Lead-sr. Data Engineer Azure

hace 7 meses

Santiago de Chile Fusemachines A tiempo completo

**About Fusemachines**

Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees). Fusemachines seeks to bring its global expertise in AI to transform companies around the world.

**About the role**:
This is a remote, 1 year contract position responsible for leading, designing, building, and maintaining the infrastructure required for data integration, storage, processing, and analytics (BI, visualization and Advanced Analytics) using Microsoft Azure in the Media domain.

**Qualification & Experience**
- Must have a full-time Bachelor's degree in Computer Science or similar from a top tier school.
- 4+ years of experience with Azure DevOps, Azure Cloud Platform, or other hyperscalers.
- At least 4 years of experience as a data engineer with strong expertise in Azure, working on generation of big datasets using different data sources, in the Media industry.
- Proven experience delivering projects and products for Data and Analytics as a data engineer.

**Following certifications**:

- Microsoft Certified: Azure Fundamentals
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Solutions Architect Expert: nice to have
- Databricks Certified Associate Developer for Apache Spark
- Databricks Certified Data Engineer Associate, nice to have

**Required skills/Competencies**
- Strong programming Skills in one or more languages such as Python (must have), Scala, and proficiency in writing efficient and optimized code for data integration, storage, processing and manipulation.
- Strong experience using Markdown to document code or automated documentation tools (e.g PyDoc).
- Strong experience with scalable and distributed Data Processing Technologies such as Spark/PySpark (must have, experience with Azure Databricks is a plus), DBT and Kafka, to be able to handle large volumes of data.
- Expert in designing and implementing efficient ELT/ETL processes in Azure (experience with Azure Data Factory is a plus) and using open source solutions being able to develop custom integration solutions as needed.
- Skilled in Data Integration from different sources such as APIs, databases, flat files, event streaming, with technologies such as Azure Data Factory.
- Expertise in data cleansing, transformation, and validation.
- Hands-on experience with Jupyter Notebooks and python packaging and dependency management: Poetry, PipEnv.
- Proficiency with Relational Databases (Oracle, SQL Server, MySQL, Postgres, or similar) and NonSQL Databases (MongoDB or Table).
- Good understanding of Data Modeling and Database Design Principles. Being able to design and implement efficient database schemas that meet the requirements of the data architecture to support data solutions.
- Strong understanding and experience with SQL and writing advanced SQL queries.
- Strong experience in designing and implementing Data Warehousing solutions in Azure with Azure Synapse Analytics and/or Snowflake.
- Familiarity with migration of code from one or more of SAS, R, Julia, SPSS to Python.
- Proven technical leadership on prior Big Data projects.
- Strong understanding of the software development lifecycle (SDLC), especially Agile methodologies.
- Strong knowledge of SDLC tools and technologies Azure DevOps, including project management software (Jira, Azure Boards or similar), source code management (GitHub, Azure Repos, Bitbucket or similar), CI/CD system (GitHub actions, Azure Pipelines, Jenkins or similar) and binary repository manager (Azure Artifacts or similar).
- Strong understanding of DevOps principles, including continuous integration, continuous delivery (CI/CD), infrastructure as code (IaC), configuration management, automated testing and cost management.
- Strong knowledge in cloud computing specifically in Microsoft Azure services related to data and analytics, such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), Azure Stream Analytics, SQL Server, Azure Blob Storage, Azure Data Lake Storage, Azure SQL Database, etc.
- Experience in Orchestration using technologies like Apache Airflow
- Strong analytical skills to identify and address technical issues, performance bottlenecks, and system failures.
- Proficiency in debugging and troubleshooting issues in complex data and analytics environments and pipelines.
- Good understanding of Data Quality and Governance, including implementation of data quality checks and monitoring processes to ensure that data is accurate, complete, and consistent.
- Good understanding of BI solutions including PowerBI and Tableau.
- Knowledge in containers and their environments (Docker, Podman, Docker-Compose, Kubernetes, Minikube, Kind, etc.) is a plus
- Effective

  • Azure Data Engineer

    hace 4 días

    Santiago de Chile Factor IT A tiempo completo

    En FactorIT estamos buscando a un Data Engineer Azure que tenga capacidad para trabajar en un entorno rápido y cambiante, así como experiência en gestión de proyectos y liderazgo de equipos. ¿Le pasas la voz? ¿Qué esperamos de nuestro Data Engineer Azure? Experiência en soporte a procesos batch, real time y APIs Certificación oficial en una o...

  • Azure Data Engineer

    hace 7 meses

    Santiago de Chile Launchpad Technologies Inc. A tiempo completo

    Launchpad, a people-first technology company, is a leader in North America´s rapidly growing tech sector. Through two solutions, Launchpad supports its clients with digital transformation: - PaasportTM, our iPaaS solution, streamlines software integration and automates workflows. - Nearshore Staff Augmentation, our managed IT staffing service, connects top...

  • Teach Lead Data Engineer

    hace 2 días

    Santiago de Chile Factor IT A tiempo completo

    En FactorIT estamos buscando a un/a Teach Lead Data Engineer que tenga 3 años o más de experiência en cargos similares. ¿Le pasas la voz? **¿Qué esperamos de nuestro Teach Lead Data Engineer** **?** - Experiência técnica liderando equipos de desarrollo en proyectos de Big Data. - Certificación de Google Cloud Platform Professional Data Engineer...

  • Azure Data Engineer

    hace 2 semanas

    Santiago de Chile Factor IT A tiempo completo

    En FactorIT estamos buscando Data Engineers que tengan capacidad para trabajar en un entorno rápido y cambiante, así como experiência en soluciones analíticas en tecnología Microsoft Azure. ¿Le pasas la voz? ¿Qué esperamos de nuestros Data Engineers? - Experiência comprobable en Azure Data Factory y sus componentes (dataflow, cargas incrementales,...

  • Data Engineer

    hace 7 meses

    Santiago de Chile SQM A tiempo completo

    **SQM**, compañía minera global que desde el norte de Chile está presente en industrias estratégicas para el desarrollo sostenible, tales como la salud, la alimentación, la tecnología y las energías limpias que mueven al mundo. Consideramos que una cultura diversa e inclusiva es vital para nuestra misión de ayudar a construir una mejor sociedad, con...

  • Data Engineer

    hace 7 meses

    Santiago de Chile Trabaja en SQM A tiempo completo

    SQM, compañía minera global que desde el norte de Chile está presente en industrias estratégicas para el desarrollo sostenible, tales como la salud, la alimentación, la tecnología y las energías limpias que mueven al mundo. Consideramos que una cultura diversa e inclusiva es vital para nuestra misión de ayudar a construir una mejor sociedad, con...

  • Azure Cloud Engineer

    hace 1 semana

    Santiago de Chile Tessera Data - Chile A tiempo completo

    Tessera Data es un equipo de exploradores de datos que prosperan en la adquisición, el procesamiento y la entrega de datos para resolver decisiones de confianza y seguridad. Únase a nuestro equipo y forme parte de: - El líder de la industria en la agregación de datos de registros públicos y la clasificación/normalización de datos - Un entorno de...

  • Data Engineer Sr

    hace 2 meses

    Santiago de Chile SOHO A tiempo completo

    **Descripción**: Somos** SOHO,** una compañía con más de 27 años de trayectoria, experta en diseño, innovación y desarrollo de experiências digitales. Nos apasiona crear experiências memorables centradas en el cliente, buscando impactar positivamente en negocios, organizaciones y sociedad. En esta oportunidad nos encontramos en la búsqueda de...

  • Data Engineer Sr

    hace 5 días

    Santiago de Chile SOHO A tiempo completo

    **Descripción**: Somos** SOHO,** una compañía con más de 27 años de trayectoria, experta en diseño, innovación y desarrollo de experiências digitales. Nos apasiona crear experiências memorables centradas en el cliente, buscando impactar positivamente en negocios, organizaciones y sociedad. En esta oportunidad nos encontramos en la búsqueda de...

  • Lead Data Engineer

    hace 7 meses

    Santiago de Chile The Bridge Social A tiempo completo

    **Descripción**: **Somos The Bridge** The Bridge es la red de profesionales digitales más grande de** LATAM** con más de 230 mil rockstars. Startups, scale-ups, grandes empresas y consultorías de todo el mundo trabajan con nosotros para conseguir los proyectos más desafiantes e impactantes. ¿Estás listo para participar en el desafío? **La...

  • Data Engineer

    hace 4 meses

    Santiago de Chile Blue Orange Digital A tiempo completo

    **Company Overview**: **Position Overview**: **Responsibilities**: - Work with Databricks, Spark, Python, and other data orchestration and ETL tools to build high-performance data pipelines. - Work with data teams to help design, build, and deploy data platforms in the cloud (Azure, AWS, GCP) and automate their operation. - Work with Azure DevOps, Azure...

  • Azure Data Architect

    hace 1 día

    Santiago de Chile IBM A tiempo completo

    **Introduction** As an IBM Application Architect, you directly help clients transform their business and solve complex problems. You will define the scope and vision for projects that deliver customized solutions using your knowledge of IBM platforms. You are a technical leader, serving as a liaison among business partners, technical resources, and project...

  • Sr. DevOps/ Cloud Engineer

    hace 7 meses

    Santiago de Chile NTT DATA A tiempo completo

    **Req ID**: 278105 We are currently seeking a Sr. DevOps/ Cloud Engineer to join our team in Santiago, Región Metropolitana de Santiago (CL-RM), Chile (CL). **Job Description - Sr DevOps Engineer/ Cloud** **Experience**:4 to 6 years **Day to Day job Duties**: - Creating complex Dockerfiles (500+ Lines of code) - Building and deploying Docker images for...

  • Data Engineer

    hace 2 semanas

    Santiago de Chile InvestorFlow A tiempo completo

    **InvestorFlow** is the only company of its kind to deliver simple and smart CRM and digital portals for deals and investors to streamline every customer interaction. Asset managers use our Salesforce-built platform to easily make transactions with increased productivity and transparency. We are looking for a ** Data Engineer** to help our customers...

  • Data Engineer

    hace 1 semana

    Santiago de Chile Factor IT A tiempo completo

    En FactorIT estamos buscando a un Data Engineer que tenga capacidad para trabajar en un entorno rápido y cambiante, así como experiência en gestión de proyectos y liderazgo de equipos. ¿Le pasas la voz? ¿Qué esperamos de nuestro Data Engineer? Profesional en Ingeniería de Sistemas, Electrónico, de Telecomunicaciones, Teleinformática y/o afines,...

  • Semi Senior Data Engineer

    hace 7 meses

    Santiago de Chile 23People A tiempo completo

    **Semi senior Data Engineer (Azure Databricks) Home Office** Salario: 2.100.000 - 2.400.000 CLP País: Residentes en Chile **Skills**: - Excluyente experiência en Azure Databricks en retail. - Habilidades fuertes de comunicación y disposición para aprender nuevos skills. - Experiência previa en soporte de producción de al menos 4 años y...

  • Semi Senior Data Engineer

    hace 7 meses

    Santiago de Chile 23People A tiempo completo

    **Semi senior Data Engineer (Azure Databricks) Home Office** Salario: 2.100.000 - 2.400.000 CLP País: Residentes en Chile **Skills**: - Excluyente experiência en Azure Databricks o fuerte experiência en PL/SQL - Habilidades fuertes de comunicación y disposición para aprender nuevos skills. - Experiência previa en soporte de producción de al menos 4...

  • Data Engineer Bilingual

    hace 4 días

    Santiago de Chile Amaris Consulting A tiempo completo

    100% remote We are looking for dynamic consultants to grow our engineering team in Chile. Your experience, knowledge, and commitment will help us to face our client's challenges. You will be supporting different projects through your expertise as Data Engineer. **Your main responsibilities**: - To develop and maintain data ingestion processes - To model...

  • Microsoft Azure Engineer

    hace 3 semanas

    Santiago de Chile SunDevs A tiempo completo

    **Join Our Team and Take Your Career to the Next Level**: Are you passionate about hybrid cloud environments, cutting-edge virtualization technologies, and ensuring high availability in enterprise solutions? If so, this is your opportunity! At SunDevs, we are seeking an experienced **Microsoft Azure Engineer** to help design, implement, and manage Azure...

  • Lead Data Engineer

    hace 7 meses

    Santiago de Chile Thoughtworks A tiempo completo

    Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems....