Senior Big Data Engineer

Job description

We are seeking a dedicated Senior Big Data Engineer to join our team at a leading financial market analytical research company.

The candidate will work within one of the top three most influential international rating agencies and contribute to sophisticated big data solutions.

Responsibilities

- Develop an analytical platform interfacing with multiple data sources for data collection and processing via NLP pipelines

- Manage efficient data searching within AWS Opensearch

- Facilitate the availability of data for internal clients and support ML flow integration

- Apply expertise in Python for scripting and automation tasks

- Employ knowledge of Elasticsearch and Enterprise Search Platforms to enhance search capabilities

- Utilize proficiency in Semantic Web and Text Analytics in project requirements

Requirements

- 3+ years of working experience as a Big Data Engineer

- Knowledge of Amazon Web Services, Elasticsearch and Enterprise Search Platforms

- Background in OpenSearch

- Skills in Python

- Understanding of Semantic Web and Text Analytics

- Proficiency in written and spoken English at Upper-Intermediate level (B2+)

Nice to have

- Expertise in Data Science

- Capability to use Kubernetes

- Competency in NLP Labeling and NLP Preprocessing

- Familiarity with Terraform