Senior Data Engineer at RWS Group, IE-Dublin
Senior Data Engineer at RWS Group in IE-Dublin. Est. up to $130k. Apply with swipeandhired.
Job Locations
IE-Dublin
Posted Date
7 hours ago (05/11/2026 11:44)
Job ID
2026-7040
# of Openings
1
Category
IT/Software Development
Banding
5
Job Purpose
About RWS
RWS is a global leader in content, translation, and intellectual property services. With more than 60 years of experience, RWS helps the world’s top brands grow by ensuring they are understood anywhere, in any language. The company combines proprietary technology with deep human expertise to deliver high-quality, compliant, and scalable solutions across industries such as life sciences, technology, finance, and legal.
About TrainAI
Training or fine-tuning artificial intelligence (AI) requires data. LOTS of data. However, not just any data will do – our clients need responsible AI data that’s targeted, accurate and reliable to ensure machine learning (ML) success. But preparing AI training data is a monumental task that can take up the vast majority of AI project time, leaving AI teams with precious little time to focus on developing, deploying and evaluating ML models. TrainAI by RWS helps our clients address this challenge head-on.
With a seamless blend of technological understanding and human intelligence, TrainAI provides complete, end-to-end data collection and content generation, data annotation or labelling, human-in-the-loop data validation and generative AI data services for all types of AI, in any language, at any scale, based on the principles of responsible AI. Today, TrainAI supports four of the world’s top five technology companies, enhancing the performance of their generative AI by providing services such as prompt engineering, response refinement and red teaming with locale-specific domain experts across a broad range of topic areas and educational levels.
Job Purpose
As a Senior Data Engineer in TrainAI, you will own the data platform that tracks and powers our AI data services, built on Databricks . Our data comes from the TrainAI platform, partner systems and third-party services. We bring it together in a Databricks lakehouse and serve it to product, operations, finance and analytics teams.
You’ll have end-to-end ownership of our Databricks pipelines, from raw ingestion through curated bronze, silver and gold layers to monitoring in production. You’ll also be the team’s Databricks expert, setting the standards for how we build, test and deploy data workloads. You’ll work inside a product engineering team rather than a separate data function, so you’ll be close to the people who use your data.
Job Overview
Responsibilities
- Own the Databricks lakehouse: Design, build and run our Databricks platform end to end, including workspaces, clusters and SQL warehouses, jobs and Unity Catalog.
- Build medallion pipelines: Build reliable ingestion and transformation pipelines through bronze, silver and gold layers on Delta Lake, using PySpark, Spark SQL and Delta Live Tables / Lakeflow where they fit.
- Integrate source systems: Ingest data from our platform databases, SaaS APIs and partner feeds, including incremental loads, change data capture and backfills of historical data.
- Orchestrate and monitor: Schedule and monitor multi-stage workflows with Databricks Workflows/Jobs. Troubleshoot failures and keep data fresh and complete.
- Optimise performance and cost: Tune Delta tables (partitioning, Z-ordering / liquid clustering, file compaction), cluster sizing and job design to keep queries fast and spend under control.
- Govern and secure data: Manage access, lineage and data quality through Unity Catalog, and handle sensitive and personal data safely.
- Engineer it like software: Treat pipelines as code, with Git, code review, automated tests, CI/CD and Databricks Asset Bundles.
- Collaborate across teams: Work with engineers, analysts and business stakeholders to turn their questions into well-modelled, trustworthy datasets.
Requirements
- Hands-on Databricks experience: Commercial experience building and running production pipelines on Databricks, including Delta Lake, Workflows/Jobs and Unity Catalog. This is the core of the role.
- Spark expertise: Strong PySpark and Spark SQL, with a working understanding of how Spark executes jobs and how to tune them.
- Lakehouse design: Experience designing medallion (bronze/silver/gold) architectures and dimensional models that analysts can use directly.
<li aria-setsize="-1" data-aria-level="1" data-aria-posinset="16" data-font="" data-leveltext="•" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}' data-listid="4" style="margin: 0px 0px 0px 24px; padding: 0px; font-size: 11pt; font-fami