Data Engineer


Job Description

  • Design and implement highly distributed and scalable components
  • Solve complex software systems problems and leverage state-of-the-art technology
  • Use cloud infrastructure services and integrate with other 1st and 3rd party services
  • Responsible for designing, developing & maintaining all parts of the data pipeline for Reporting and Analytics requirements
  • Design, develop and orchestrate data pipelines for real-time and batch data processing
  • Design and develop reusable components and frameworks for ingestion, cleansing, and data quality Improve quality of data, and ingest data from several data sources
  • Quickly create functioning ETL prototypes to address quickly changing business needs
  • Knowledgeable in Big Data

Job Requirement

  • ETL experience using SQL, Shell Scripting and Python is desirable
  • Strong skills working with very large data sets with a variety of tools
  • Knowledge of working with business intelligence tools NoSQL experience (Cassandra, MongoDB)
  • Development experience using Big data technologies
  • Development experience using Java for data processing

Don’t be discouraged when you lack one or two listed skill, I’m sure we can do something about that ;)

Data AnalysisShell ScriptingPythonNoSQLCassandraMongoDBBig DataJava