Health elevated.

Data Engineer

Inito

Inito

Software Engineering, Data Science
Bengaluru, Karnataka, India
Posted on Tuesday, October 3, 2023

Job Description

Experience : 1 to 7 years

Open Positions : 3

Job Summary:

Inito is seeking an experienced data engineer to join our team. The ideal candidate will be responsible for designing and implementing data systems that support our machine learning and natural language processing (NLP) applications.

Responsibilities:

  • Design, implement and maintain data systems that support machine learning and NLP applications.
  • Collaborate with data scientists, software developers, and other stakeholders to understand the requirements and implement solutions.
  • Develop and maintain data pipelines using DVC, Dask, Elasticsearch, PySpark, Pandas, Python, and Airflow. Optimize data processing and analysis by identifying and addressing bottlenecks, improving data quality, and implementing automated data quality checks.
  • Ensure data security and privacy by implementing access controls and data encryption. Stay current with new and emerging data technologies and tools.

Qualifications:

  • bachelor's degree in computer science, Software Engineering, or a related field. 1-7 years of experience in data engineering.
  • Strong programming skills in Python and experience with data manipulation libraries such as Pandas and Numpy. Experience with data processing tools such as DVC, Dask, Elasticsearch, PySpark, and Airflow.
  • Experience with natural language processing (NLP) tools and techniques.
  • Experience working with large-scale data and implementing scalable data architectures.
  • Familiarity with database design and management, SQL, and NoSQL databases. Knowledge of distributed computing systems and cloud computing platforms such as AWS .
  • Excellent communication and collaboration skills.
  • Familiarity with Git, GitLab, VSCode, and Streamlit.

Preferred Qualifications:

  • Experience with machine learning frameworks such as TensorFlow, Keras, or PyTorch. Familiarity with agile software development methodologies.
  • Experience with containerization tools such as Docker and Kubernetes.
  • Experience with real-time data processing technologies such as Kafka or Spark Streaming.

  • We are an equal opportunity employer and welcome all qualified applicants.