Lead / Senior Data Engineer / Scientist

Tech Hire Ventures
Full-timeColombo, Sri Lanka

About the company & the role

Our client is an established software service outsourcing company in 1996. Offers software solutions to the Scandinavian market, with most of our clients coming from Norway's ISV sector.

Strive to push the boundaries of producing high-quality products and services by focusing on long-term relationships with our clients and assisting them in accomplishing their short-term and long-term goals.

Requirements

  • Bachelor’s degree in computer science, Information Technology, or a related field
  • 3+ years of experience as a Software Engineer or related role
  • Experience with large-scale search systems and big data technologies.
  • Strong experience with JAVA, Node, Python, PySpark, Scala, and Spark
  • Experience with NoSQL datastores like Elasticsearch
  • Experience with real-time data processing technologies (e.g., Apache Kafka, Apache Flink
  • Proven experience with SQL and writing complex queries
  • Experience with cloud platforms (e.g., AWS, Azure, GCP)
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration skills
  • Ability to work independently and as part of a team
  • Practical exposure to software scalability, performance, and resiliency optimization techniques.
  • Experience working with Apache Iceberg will be an added advantage
  • Experience with PyTorch, TensorFlow, R or similar technologies will be added advantage
  • Familiarity with working in an agile development environment, along with exposure to DevOps tools and methodologies

Responsibilities

  • Develop custom software products that scale for enterprise demands, based on functional guidance from product management and technical guidance from engineering leadership.
  • Develop code to support search engineering including ingestion and processing of data, optimizing the search algorithm and developing search related features using Python, PySpark, Scala, Spark, Java and related technologies.
  • Utilize Elasticsearch for data storage and retrieval
  • Contribute to, and occasionally lead, technical meetings on a regular basis to clearly articulate engineering development status and escalate issues with tasks assigned.
  • Participate in research and development work to advance engineering and product organizational objectives.
  • Ensure high code quality by following software engineering best practices.
  • Work collaboratively in a cross functional team in an Agile delivery environment.
  • Adhere to DevOps principles and be involved in projects throughout their full software development lifecycle: from development, QA and deployment to post-production support.
  • Actively engage with internal training courses and offerings to improve technical and non-technical skills.

Apply for this job

Resume/CV*

Click or drag file to this area to upload your Resume

Please make sure to upload a PDF

First Name*
Last Name*
Email*
Phone Number*
What is your current salary?*
What is your expectation?*
What is your notice period?*
How did you hear about this opportunity?