Cloud Engineer (AWS and Databricks)

Job description

Cloud Engineer (AWS and Databricks)

Talent Hunter is an IT and Telecom Recruitment Company ensuring the best professional opportunities for talents in the high-tech industry and providing quick and cost-effective solutions to client companies seeking the best talent for their business. We believe that each one of us is designing our lives through the everyday choices we make.

Cloud Engineer (AWS & Databricks)

Infrastructure, Security & Platform | Databricks on AWS

About Our Client:

Talent Hunter is looking for an experienced Cloud Engineer (AWS & Databricks) to join our client — an international organization operating in the renewable energy sector and investing heavily in data, analytics, and AI technologies.

Our client is currently building a modern data and AI platform designed to support large-scale analytical and machine learning initiatives.

This is an excellent opportunity for a hands-on Cloud Engineer who wants to build a cloud platform from the ground up, make key architectural decisions, and take ownership of security, scalability, reliability, and cost optimization.

About the Role:

– As a Cloud Engineer, you will own the AWS infrastructure on which the organization’s data and AI platform will run.

– This is a true greenfield project. The Terraform environment is yet to be built, the AWS account is at an early stage, and the target architecture has already been defined but not yet implemented.

– Your main responsibility during the initial phase will be to translate the architecture into a secure, scalable, highly available, and cost-efficient production platform.

– You will enable a small team of data engineers and data scientists to focus on their models and pipelines while you take care of the underlying cloud infrastructure and platform.

– Following the initial build phase, there is potential for the engagement to continue on a part-time basis, depending on both the project’s needs and your preferences.

What You Will Own:

– Design and deploy the AWS account structure, VPC architecture, and network segmentation for Databricks on AWS using Terraform.

– Configure and harden the Databricks workspace, including: AWS S3 landing zone; Bronze, Silver, and Gold layers; MLflow;

IAM roles and instance profiles; Cluster policies; Cost controls.

– Deploy and operate Amazon MWAA (Managed Workflows for Apache Airflow) for external data ingestion.

– Implement the secrets management architecture using AWS Secrets Manager, including rotation policies for external API credentials.

– Build and maintain the CI/CD pipeline using GitHub Actions for infrastructure changes and workspace configuration.

– Configure AWS CloudWatch and platform observability, including dashboard tooling such as Grafana and alerting for:

ingestion failures; compute-related issues; unusual or unexpected cloud costs.

– Contribute to the NIS2 and compliance posture of the cloud environment.

Implement and maintain: AWS CloudTrail; encryption at rest and in transit; network access controls; audit logging.

– Design and configure High Availability across two AWS Availability Zones.

– Ensure the Databricks environment is appropriately designed for failover across two Availability Zones.

What You Will Not Own:

– Your focus will be the cloud infrastructure and platform layer, rather than the data and machine learning workloads running on top of it.

You will not be responsible for:

Data pipelines;

dbt transformations;

ML model infrastructure;

Data science models.

These areas will be owned by the Data Engineer and Data Scientists.

You will work closely with the Data Engineer on the boundary layer — including cluster policies, Unity Catalog permissions, and S3 access patterns — but responsibilities will be clearly defined.

What We Are Looking For:

– 4+ years of hands-on experience building and operating production infrastructure on AWS.

– Strong practical experience with: AWS VPC; IAM; S3; AWS networking; Cloud security.

– Proven hands-on experience with Databricks on AWS, including: workspace configuration; Unity Catalog; cluster policies;

instance profiles.

– Previous experience with Amazon MWAA.

– Familiarity with Databricks Asset Bundles (DABs).

– Strong practical experience with Terraform, including the ability to design and maintain your own modules rather than simply applying existing ones.

– Experience using Terraform for AWS infrastructure and DABs for asset/job deployment.

– Strong understanding of AWS networking concepts, including: PrivateLink; VPC endpoints; Security Groups;

networking requirements for Databricks in a customer-managed VPC.

Working knowledge of AWS security services, including: CloudTrail; AWS Config; Security Hub; GuardDuty.

Nice to Have:

– Experience in energy, utilities, or other regulated industries, where compliance and auditability are critical.

– Experience implementing NIS2 requirements.

– Experience with ISO 27001 implementation.

– Previous experience building a greenfield cloud platform.

– Experience designing and implementing highly available AWS architectures.

– Experience working in small, highly autonomous technical teams.

We offer:

– Attractive compensation package;

– Career and Development – worldwide career opportunities, access to a high-tech Engineering Lab;

– Work That Fits Your Life- possibility to work from home, transition support through life events.

– Wellness and Health Programs;

– Additional Health Insurance with Dentist (Luxury package);

– Certification and Training Programs;

– Performers Bonus Scheme;

– Food Stamps (extra money to the salary for food);

– Extra Days Paid Leave;

– Secured Parking Space;

– Exciting Workplace Experience;

Please send your recent CV stating the position title in the subject line and we will contact you if you have the required skill set!

Licensed by MLSP, license N 2651, valid from 29.10.2018

Talent Hunter Ltd. informs you that part of the data you provide by sending your application is personal data and falls under the special treatment and protection of the Data Protection Law and the 2016/679 Regulation. The provided personal data will be processed for legally acknowledged purposes, related to the present job ad, as well as to the realization of the legal interest of the personal data administrator. Talent Hunter Ltd. processes, stores, and uses the voluntarily provided personal data in legally determined timeframes, guaranteeing their security and confidentiality. Please be informed that hereby you agree that Talent Hunter Ltd. might provide your personal data to governmental bodies and institutions, or third parties when there is such obligation by law, or it is required for the realization of your rights and legal interests as a participant in a recruitment process with the purpose of concluding a future labor contract. As per the internal rules of Talent Hunter Ltd. you have the right to access and edit your personal data, the right to be deleted, and the right to object to processing, presenting, or revealing of your personal data for purposes different from the ones, stated above.