Senior Data Lake Developer

hace 4 semanas

Santiago, Chile Talan A tiempo completo
Senior Data Lake Developer

4 days ago Be among the first 25 applicants

Why Talan?

For the 4th consecutive year , Talan Spain has been recognized as a Great Place to Work This year, we’re also celebrating our 2nd certification in Poland , a significant milestone since opening our office there.

Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover of 600M€. We offer our customers a continuum of services to support them at each key stage of their organization's transformation, with four main activities:

  • CONSULTING in Management and Innovation: Supporting business, managerial, cultural, and technological transformations.
  • DATA & TECHNOLOGY: Implementing major transformation projects.
  • CLOUD & APPLICATION SERVICES: Building or integrating software solutions.
  • SERVICE CENTERS of EXCELLENCE: Providing technology, innovation, agility, sustainability of skills, and cost optimization.

Talan accelerates its clients' transformation through innovation and technology. By understanding their challenges and supporting them with technology, innovation, and data , we enable them to be more efficient and resilient.

Job Description

Our client has started a greenfield project to build an in-house data lake solution, named Origin. This will serve various BI services and projects as well as other Data Science tools and initiatives within CIB. Origin will ingest near real-time market data from multiple sources and centrally store them on the cloud (AWS). The scope and type of the data consumed, and target consumers will continue to expand.

Currently, the existing functionality includes the following:

  • Ingestion of multiple data sources in batch / near real-time in shared storage.
  • Decoupled storage from compute and data processing to provide increased scalability and performance while reducing storage costs.
  • The data is compressed and partitioned using parquet data formats, which improves performance while reducing the cost of data retrieval.
  • Centralized metadata catalogue that maintains a single view of the data model for all its consumers.
  • Integration with other AWS services (Athena, EMR, QuickSight) and third-party solutions (Apache Spark, Presto, Tableau).

The project is sponsored at high levels within the business and is a new initiative. Working in a small development team, the focus will be on delivering high-quality solutions for electronic trading and pricing workflows. The aim of the project is to build an agile team that works closely with the business sponsors to ensure a high-quality platform that delivers on the needs of a global trading business.

Your Role

As a Senior developer, you will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high-quality ETLs. This is an exciting opportunity to build a new greenfield solution, working as part of a small team, to help the business improve their market-making capabilities within the fixed income space. The platform itself is housed within the AWS ecosystem.

Job Responsibilities:
  • Take responsibility for the software delivery by ensuring quality and scope expectations are met.
  • Contribute and take ownership of the technical design and ensure all aspects of the system architecture are well documented.
  • Work closely with partner technology teams and collaborate effectively.
  • Candidates must have the technical skills listed below, and in addition, have worked within a data team in the last 5–10 years.
QualificationsEducation:
  • Bachelor degree in Computer Science / Information Technology or a related field, or substantial practical experience of software delivery at an advanced level.
Technical Skills Required:
  • Very deep understanding of Tableau
  • Experience in SQL, Hive, Hadoop.
  • Experience Python, Pyspark, Pandas, JulyterLab (working with notebooks).
  • Experience using AWS platform.
  • Experience with continuous integration and continuous delivery tools like Git, Jenkins etc.
  • Agile development/Software life cycle.
  • Excellent interpersonal and communication skills in English (b2+).
Nice to have Skills:
  • Experience with Kafka
  • Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark clusters.
  • Knowledge of Terraform
  • Experience with Ansible, Bash scripting, boto3
  • Experience configuring continuous integration and continuous delivery tools.
Soft Skills:
  • Energetic, motivated, and determined
  • Pragmatic and results-oriented
  • Adaptable to diverse set of technical responsibilities
  • Excellent analytical and problem-solving skills.
  • Productive and able to manage time effectively.
  • Strong written and verbal communication skills.
Additional InformationWhat do we offer you?
  • Full-time contract
  • Training and career development opportunities.
  • Be part of a multicultural team working on international projects.

If you have read this far and you are looking forward to joining this challenge, do not hesitate to apply... we would be delighted to meet you

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

Software Development and IT Services and IT Consulting

#J-18808-Ljbffr

  • Senior Data Lake Developer Expert

    hace 2 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Job Description:We are seeking a highly skilled Senior Data Lake Developer to join our team at Talan. As a key member of our data engineering team, you will be responsible for designing and implementing scalable and secure data lake solutions using AWS.The ideal candidate will have a deep understanding of big data technologies, including Hadoop, Spark, and...

  • Cloud Engineer

    hace 3 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Job DescriptionWe are seeking a highly skilled Senior Data Lake Developer to join our team. As a Senior developer, you will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high-quality ETLs. This is an exciting opportunity to build a new greenfield solution, working as...

  • Senior Data Lake Developer

    hace 2 semanas

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Senior Data Lake Developer 4 days ago Be among the first 25 applicants Why Talan? For the 4th consecutive year , Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland , a significant milestone since opening our office there. Talan is an international advisory group...

  • Senior Data Lake Developer

    hace 4 semanas

    Santiago, Chile Talan A tiempo completo

    Press continue to see content specific to your location. United States Senior Data Lake Developer Location: Santiago Salary: CLP 20,000,000 - 40,000,000 Be among the first applicants. Posted: 5 days ago Why Talan? For the 4th consecutive year , Talan Spain has been recognized as a Great Place to Work ! This year, we’re also...

  • Senior Data Lake Developer

    hace 3 semanas

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Press continue to see content specific to your location. United States Senior Data Lake Developer Location: Santiago Salary: CLP 20,000,000 - 40,000,000 Be among the first applicants. Posted: 5 days ago Why Talan? For the 4th consecutive year , Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating...

  • Cloud Native Data Engineer

    hace 5 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    Are you passionate about working with big data and helping organizations make informed decisions? Do you want to join a dynamic and innovative team that is shaping the future of data-driven business?We are Talan Group, a global advisory company that specializes in innovation and transformation through technology. Our team is looking for a highly skilled...

  • Senior Data Lake Developer

    hace 5 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    For the 4th consecutive year , Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland , a significant milestone since opening our office there. Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and...

  • Senior Data Lake Developer

    hace 2 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Company DescriptionJoin UsWhy Talan?For the 4th consecutive year, Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland, a significant milestone since opening our office there.Talan is an international advisory group specializing in innovation and transformation through technology, with...

  • Senior Data Lake Developer

    hace 6 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Company Description Join Us Why Talan? For the 4th consecutive year , Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland , a significant milestone since opening our office there. Talan is an international advisory group specializing in innovation and transformation...

  • Big Data Ingestion Specialist

    hace 5 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    Talan Group is a leading advisory company that accelerates its clients' transformation through innovation and technology. We are currently seeking a Senior Data Lake Developer to join our team and work on a exciting project to build an in-house data lake solution named Origin.As a member of our team, you will be responsible for designing and implementing a...

  • Sr. Data Architect, Data Lake, Professional Services

    hace 3 semanas

    Santiago, Metropolitana, Chile Amazon A tiempo completo

    Press continue to see content specific to your location. United States Sr. Data Architect, Data Lake, Professional Services Santiago CLP 20,000,000 - 40,000,000 Be among the first applicants. 4 days ago Job ID: 2685274 | Amazon Web Services Argentina S.R.L. - F61 Are you a Data Analytics specialist? Do you have Data Lake/Hadoop experience? Do...

  • Senior Cloud Solutions Architect

    hace 3 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Technical RequirementsWe are looking for a highly skilled Senior Data Lake Developer with experience in working with big data ingestion and large data sets in general. The ideal candidate should have a deep understanding of Tableau, experience in SQL, Hive, Hadoop, Python, Pyspark, Pandas, JupyterLab, and AWS platform. Additionally, experience with...

  • Data Engineer Senior+

    hace 3 semanas

    Santiago, Metropolitana, Chile Talent Connect A tiempo completo

    Join Globant and participate in great projects We are looking for a skilled Data Engineer Senior+ specializing in Azure to be a part of our innovative and dynamic environment in Chile.Role OverviewAs a Data Engineer Senior+ with a focus on Azure, you will collaborate with our client's IT department to provide leadership, vision, and direction in implementing...

  • Big Data Solutions Architect

    hace 2 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Overview:Talan is an international advisory group specializing in innovation and transformation through technology. We offer our customers a continuum of services to support them at each key stage of their organization's transformation.As a Senior Data Lake Developer, you will play a critical role in helping us deliver high-quality solutions for electronic...

  • Data Engineer Senior+

    hace 4 semanas

    Santiago de Chile Talent Connect A tiempo completo

    Join Globant and participate in great projects! We are looking for a skilled Data Engineer Senior+ specializing in Azure to be a part of our innovative and dynamic environment in Chile. **Role Overview**: As a Data Engineer Senior+ with a focus on Azure, you will collaborate with our client's IT department to provide leadership, vision, and direction in...

  • Data Developer

    hace 3 días

    Santiago, Chile SOAINT A tiempo completo

    Hola hola en Soaint Estamos buscando el mejor Data Developer o Líder Técnico - Conocimiento de Python/sql/Linux. - Ideal haber trabajado en la nube de GCP, si es AWS podrían tener conversión mas rápida. - Conocimientos de cloud function + composer (airflow). Capacidades mas softs como: - Empoderamiento de los requerimientos - Búsqueda proactiva de...

  • Senior Ecommerce Developer

    hace 45 minutos

    Santiago, Metropolitana, Chile McFadyen Digital A tiempo completo

    Senior Ecommerce Developer & Team LeadWe are seeking a Senior Ecommerce Developer & Team Lead to join our team at McFadyen Digital. As a Senior Ecommerce Developer & Team Lead, you will be responsible for driving the development and management of our BigCommerce-based e-commerce platform.You will lead development efforts, manage the BigCommerce platform, and...

  • Eq: Data Engineer

    hace 1 semana

    Santiago de Chile TATA CONSULTANCY SERVICES CHILE S.A. A tiempo completo

    En Tata Consultancy Services nos encontramos en búsqueda de Data Engineer Sénior para participar con Agencia multinacional de informes de crédito al consumidor en importantes desafíos. El contrato es indefinido por Tata Consultancy Services. Un Data Engineer - Perfil Python Developer para atributos: 3+ años de exp minimo, conocimiento de Git, SQL y...

  • Business Intelligence Developer Semi Senior o…

    hace 3 semanas

    Santiago, Metropolitana, Chile Pepiln A tiempo completo

    En Pepiln nos encontramos en Búsqueda de un Business Intelligence Developer Semi Senior o Senior Requisitos: Experiencia mínima de 3 años en roles similares. Conocimientos en: PostgreSQL BigQuery (excluyente) DataStore DynamoDB Desarrollo de DataWarehouse en BigQuery (excluyente) Análisis de datos. Data Catalog y Data Quality. Python....

  • Senior Data Engineer

    hace 3 días

    Santiago de Chile Betterfly A tiempo completo

    ¿Eres un apasionado por la creación de productos digitales? ¿Tienes experiência en el mundo de Seguros? Esta oportunidad es para ti! Estamos en búsqueda de un Senior Data Engineer para una importante compañía de Insurance en etapa de desarrollo de nuevos productos situada en Santiago de Chile. Responsable del desarrollo, implementación y...