Senior Data Lake Developer

hace 3 semanas

Santiago, Metropolitana, Chile Talan A tiempo completo
Senior Data Lake Developer

4 days ago Be among the first 25 applicants

Why Talan?

For the 4th consecutive year, Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland, a significant milestone since opening our office there.

Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover of 600M€. We offer our customers a continuum of services to support them at each key stage of their organization's transformation, with four main activities:

  • CONSULTING in Management and Innovation: Supporting business, managerial, cultural, and technological transformations.
  • DATA & TECHNOLOGY: Implementing major transformation projects.
  • CLOUD & APPLICATION SERVICES: Building or integrating software solutions.
  • SERVICE CENTERS of EXCELLENCE: Providing technology, innovation, agility, sustainability of skills, and cost optimization.

Talan accelerates its clients' transformation through innovation and technology. By understanding their challenges and supporting them with technology, innovation, and data, we enable them to be more efficient and resilient.

Job Description

Our client has started a greenfield project to build an in-house data lake solution, named Origin. This will serve various BI services and projects as well as other Data Science tools and initiatives within CIB. Origin will ingest near real-time market data from multiple sources and centrally store them on the cloud (AWS). The scope and type of the data consumed, and target consumers will continue to expand.

Currently, the existing functionality includes the following:

  • Ingestion of multiple data sources in batch / near real-time in a shared storage.
  • Decoupled storage from compute and data processing to provide increased scalability and performance while reducing storage costs.
  • The data is compressed and partitioned using parquet data formats, which improves performance while reducing the cost of data retrieval.
  • Centralized metadata catalogue that maintains a single view of the data model for all its consumers.
  • Integration with other AWS services (Athena, EMR, QuickSight) and third-party solutions (Apache Spark, Presto, Tableau).

The project is sponsored at high levels within the business and is a new initiative. Working in a small development team, the focus will be on delivering high-quality solutions for electronic trading and pricing workflows. The aim of the project is to build an agile team that works closely with the business sponsors to ensure a high-quality platform that delivers on the needs of a global trading business.

Your Role

As a Senior developer, you will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high-quality ETLs. This is an exciting opportunity to build a new greenfield solution, working as part of a small team, to help the business improve their market-making capabilities within the fixed income space. The platform itself is housed within the AWS ecosystem.

Job Responsibilities:
  • Take responsibility for the software delivery by ensuring quality and scope expectations are met.
  • Contribute and take ownership of the technical design and ensure all aspects of the system architecture are well documented.
  • Work closely with partner technology teams and collaborate effectively.
  • Candidates must have the technical skills listed below, and in addition, have worked within a data team in the last 5–10 years.
QualificationsEducation:
  • Bachelor degree in Computer Science / Information Technology or a related field, or substantial practical experience of software delivery at an advanced level.
Technical Skills Required:
  • Very deep understanding of Tableau
  • Experience in SQL, Hive, Hadoop.
  • Experience Python, Pyspark, Pandas, JupyterLab (working with notebooks).
  • Experience using AWS platform.
  • Experience with continuous integration and continuous delivery tools like Git, Jenkins etc.
  • Agile development/Software life cycle.
  • Excellent interpersonal and communication skills in English (B2+).
Nice to have Skills:
  • Experience with Kafka
  • Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark clusters.
  • Knowledge of Terraform
  • Experience with Ansible, Bash scripting, boto3
  • Experience configuring continuous integration and continuous delivery tools.
Soft Skills:
  • Energetic, motivated, and determined
  • Pragmatic and results-oriented
  • Adaptable to diverse set of technical responsibilities
  • Excellent analytical and problem-solving skills.
  • Productive and able to manage time effectively.
  • Strong written and verbal communication skills.
Additional InformationWhat do we offer you?
  • Full-time contract
  • Training and career development opportunities.
  • Be part of a multicultural team working on international projects.

If you have read this far and you are looking forward to joining this challenge, do not hesitate to apply... we would be delighted to meet you

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

Software Development and IT Services and IT Consulting

#J-18808-Ljbffr

  • Senior Data Lake Developer

    hace 1 semana

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Sr. Data Lake Developer Position at TalanTalan seeks a seasoned Sr. Data Lake Developer to spearhead the design, development, and maintenance of an extensive data lake solution on AWS.About the OpportunityThis is an exciting chance to build a cutting-edge greenfield solution from scratch, collaborating closely with business stakeholders to deliver...

  • Data Lake Architect and Engineer

    hace 1 semana

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Job SummaryWe are seeking a Senior Data Lake Developer to join our team and work on building an in-house data lake solution. The ideal candidate will have experience in working with big data ingestion and large data sets, as well as creating and maintaining high-quality ETLs.The successful candidate will be responsible for delivering high-quality solutions...

  • Senior Data Lake Developer

    hace 3 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Senior Data Lake Developer4 days ago Be among the first 25 applicantsWhy Talan?For the 4th consecutive year, Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland, a significant milestone since opening our office there.Talan is an international advisory group specializing in innovation and...

  • Big Data Developer

    hace 6 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    Talan Group, a leading provider of innovation and technology solutions, is seeking a skilled Senior Data Lake Developer to join its team. The successful candidate will be responsible for designing and implementing an in-house data lake solution using AWS services and collaborating with partner technology teams to ensure seamless integration of the data lake...

  • Senior Data Engineer

    hace 6 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    Talan Group, an international advisory group specializing in innovation and technology, is seeking a skilled Senior Data Lake Developer to join its team. The successful candidate will be responsible for designing and implementing an in-house data lake solution using AWS services.Job OverviewThe Talan Group's client has initiated a greenfield project to build...

  • Senior Data Lake Developer

    hace 3 semanas

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    For the 4th consecutive year, Talan Spain has been recognized as a Great Place to Work This year, we're also celebrating our 2nd certification in Poland, a significant milestone since opening our office there.Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover...

  • Cloud Data Architect

    hace 6 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    Talan Group is looking for a talented Senior Data Lake Developer to join its team and contribute to the development of an innovative in-house data lake solution. The successful candidate will be responsible for creating and maintaining high-quality ETLs and working closely with partner technology teams to ensure seamless integration of the data lake...

  • Data Scientist

    hace 6 días

    Santiago, Metropolitana, Chile Talan Group A tiempo completo

    Talan Group, a global leader in innovation and technology, is seeking a talented Senior Data Lake Developer to join its team. The successful candidate will be responsible for creating and maintaining high-quality ETLs and working closely with partner technology teams to ensure seamless integration of the data lake solution.About the OpportunityThis is an...

  • Data Engineer Senior+

    hace 1 semana

    Santiago, Metropolitana, Chile Talent Connect A tiempo completo

    Join Globant and participate in great projects We are looking for a skilled Data Engineer Senior+ specializing in Azure to be a part of our innovative and dynamic environment in Chile. Role Overview As a Data Engineer Senior+ with a focus on Azure, you will collaborate with our client's IT department to provide leadership, vision, and direction in...

  • Data Engineer Senior+

    hace 2 semanas

    Santiago, Metropolitana, Chile Talent Connect A tiempo completo

    Join Globant and participate in great projects We are looking for a skilled Data Engineer Senior+ specializing in Azure to be a part of our innovative and dynamic environment in Chile.Role OverviewAs a Data Engineer Senior+ with a focus on Azure, you will collaborate with our client's IT department to provide leadership, vision, and direction in implementing...

  • Data Lake Architect and Engineer

    hace 3 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    Job DescriptionThe company has started a greenfield project to build an in-house data lake solution, named Origin. This will serve various BI services and projects as well as other Data Science tools and initiatives within CIB. Origin will ingest near real-time market data from multiple sources and centrally store them on the cloud (AWS). The scope and type...

  • Data Intelligence Developer

    hace 2 semanas

    Santiago, Metropolitana, Chile Practia Global A tiempo completo

    We are looking for a Data Intelligence Developer to join our team at Practia Global. As a Senior Business Insights Analyst, you will be responsible for developing and maintaining data-driven insights to support business decision-making.Job OverviewDevelop and maintain data pipelines and ETL processes to ensure high-quality data is available for...

  • Enterprise Data Strategist

    hace 1 semana

    Santiago, Metropolitana, Chile Amazon A tiempo completo

    Key ResponsibilitiesHelp the customer define and implement data architectures (Data Lake, Lake House, Data Mesh, etc).Deliver on-site technical assessments with partners and customers.Engage with the customer's business and technology stakeholders to create a compelling vision of a data-driven enterprise.Collaborate with AWS field sales, pre-sales, training...

  • Senior Python Developer

    hace 5 días

    Santiago, Metropolitana, Chile Infosys Technologies A tiempo completo

    OverviewWe are a leading global digital services and consulting company, driving the digital transformation of clients across 50 countries.Our team is seeking an experienced Senior Python Developer to join our dynamic team in Chile, Santiago. This role will be part of our Infy Chile group, focusing on IT Service Management.About the RoleThis Senior Python...

  • Cloud-Based Data Warehouse Developer

    hace 3 días

    Santiago, Metropolitana, Chile Talan A tiempo completo

    About the RoleAs a Senior developer, you will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high-quality ETLs. This is an exciting opportunity to build a new greenfield solution, working as part of a small team, to help the business improve their market-making...

  • Senior Backend Developer

    hace 4 días

    Santiago, Metropolitana, Chile Tessera Data A tiempo completo

    About UsTessera Data is a dynamic company that's changing the way people think about work. We've created a platform that uses modern technology to screen job seekers more efficiently. Our team is dedicated to making a positive impact and creating opportunities for everyone.We're looking for a skilled Senior Software Engineer - Ruby on Rails to join our...

  • Principal Software Developer

    hace 1 semana

    Santiago, Metropolitana, Chile Tessera Data A tiempo completo

    About the RoleThe Senior Software Engineer will be responsible for integrating a recently acquired background check product into the Tessera Data ecosystem, transforming it into a robust foundation for a comprehensive identity verification solution.

  • Senior Software Developer Position

    hace 1 semana

    Santiago, Metropolitana, Chile SOAINT A tiempo completo

    Senior Software Developer PositionSaint is a leading Financial Services and Investment Banking organization. We are currently seeking a skilled Senior Software Developer to contribute to our software operations.About the Role:This is an excellent opportunity for a talented Senior Software Developer to join our team and lead the development of high-quality...

  • Senior Math Algorithm Developer

    hace 1 semana

    Santiago, Metropolitana, Chile Scopic Software A tiempo completo

    We are seeking an experienced Senior Math Algorithm Developer to join our team of experts in cutting-edge applications. This is a remote position that requires strong knowledge of geometric algorithms and 3D data structures, as well as solid foundations in math and 3D geometry.Requirements:5+ years of experience in software development using modern C++....

  • Senior Developer

    hace 2 semanas

    Santiago, Metropolitana, Chile Ottomatik A tiempo completo

    Hi there We are South and our client is looking for a Sr DeveloperNote to Applicants:Eligibility: This position is open to candidates residing in Latin America.Application Language: Please submit your CV in English. Applications submitted in other languages will not be considered.Professional Presentation: We encourage you to showcase your professional...