Senior Data Engineer - Big Data (m/f/diverse)
Welcome to the team:
Senior Data Engineer - Big Data (m/f/diverse)
* Function:Information Technology
* Location:Lodz
* Job type: / Full time
* First working day:7 / 1 / 2024
* Application deadline:11 / 23 / 2024
[Apply now: https://jobs.commerzbank.com/index.php?ac=application&jobad_id=51314](https://jobs.commerzbank.com/index.php?ac=application&jobad_id=51314)
Join our team as a Senior Data Engineer!
## Your tasks
As a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area. You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts and implementing best practices for our Cloud-based data ingestion solutions. Furthermore, in your role you will be responsible for the investigation, preparation and migration of our Products from our On-Premise infrastructure to the Cloud native (GCP and Azure).
A dynamic and representative working environment in a collegial atmosphere and attractive benefits ensure that you feel at home from the start.
What you will be doing?
* Working in a task orientated and Test Driven Team to investigate our Product and choose the candidates for On-Premise to Cloud migration
* Implement and maintain cloud-native landing and solutions
* Develop future-proof software solutions to Connect cloud and on-premise and viseversa
* Integrate security standards, policies and controls into service offerings
Alternative tasks:
* Focusing on stability, performance tuning and innovation of the applications
* Coaching colleagues and end users, actively contributing to knowledge sharing and to a learning culture
## Your profile
Which technology & skills are important for us?
* Cloud Data Development: Design and develop cloud-based data storage solutions using Google Cloud Platform services such as Cloud Composer, Dataproc, Dataflow and Pub/Sub
* Build and maintain data pipelines to ensure data accuracy, consistency, and real-time processing
* Optimize data infrastructure for performance, scalability and reliability
* Infrastructure as Code (IaC): Utilize Terraform to create and manage cloud resources efficiently
* Implement CI/CD pipelines for automated deployment and continuous integration
* Microservices and API: Work with microservices architecture and design APIs for seamless data integration
* Scripting and Testing: Proficient in Python and SQL for ETL processes, schema evolution pipeline development and performance tuning
* Develop, test, and deploy solutions using Dataproc, Dataflow, and Cloud Functions
* Scala Expertise: Leverage Scala for Dataproc pipeline development, enhancement and performance tuning
How?
Hybrid on Wersalska 6 street (two days per week)
Bookmark jobadPrint job adShare job ad
## The company
What we offer
* Medical care packages in Enel-med,
* Additional Generali insurance,
* Multisport Plus Card,
* Sodexo Lunch Pass card,
* Co-financing of glasses or contact lenses,
* PPE- Employee pension scheme, in which the employer's contribution is 4.5% of the monthly salary,
* Special offer at mBank for Commerzbank employees,
* Special offers within mBank group (including free access to Legimi ebooks, special offer in Orange, discounts in chosen car salons),
* Access to the Speexx e-learning language platform,
* Access to O’Reilly and Clix (Linkedin Learning) e-learning platform,
* Internal training program Skills@work (coffee Learning Session - informal quarterly meetings among employees focusing on a given technological or business issue, BigUP- individual mentoring program focused on soft skills development, Coach Academy - Technical training organized by employees for employees, Guilds - groups focusing on a given technology),
* External trainings,
* Interest groups and integration events,
* Relocation packages inside and outside Poland,
* Psychological support program for employee and family, additionally financial and legal consultations (chat, phone, 24/7),
* Additional holiday days after each year worked at Commerzbank (maximum 5 additional days),
* Compensation of up to 100% for sick pay (up to 33 days in a given calendar year),
* Equivalent for electricity and internet while working for home,
* Flexible working time,
* Masterbenefit - car subscription,
* Travel allowance of 150 pln for each arrival for the first year of work in Commerzbank for employees who are living outside of Łódzkie and their previous employer was located outside of Łódzkie.
* Annual bonus, which amount depends of the results of the bank.
Below you can find more information about Commerzbank:
Commerzbank is a leading international commercial bank with branches and offices in almost 50 countries. The world is changing, becoming digital, and so we are. We are leaving the traditional bank behind us and are choosing to move forward as a digital enterprise. This is exactly why we need talented people who will join us on this journey. We work in inter-locational and international teamwork in agile methodologies.
Description of the cluster:
The Big Data cluster is the enabler for data scientists and provides a huge collection of data and a data science workbench in one place.
* BI technology within the lake infrastructure
* Establish a stable, state-of-the-art technology base with on-prem and cloud solutions
* Set up data lake as single data and analytics hub and effectively ingest most important data sources
* Establish data quality and metadata management
* Provide Data Marts and sandboxes for segments and functions with the most important combination of data sources
## Contact
Commerzbank Aktiengesellschaft Spółka Akcyjna oddział w Polsce
Ul. Wersalska 6
91-203 Łódź
## Your application process
Please add the following clause to your application:
1. I consent to the processing of personal data contained in this document by Commerzbank Aktiengesellschaft with its registered office in Kaiserstrasse 16, 60311 Frankfurt am Main, Germany, operating through the Branch in Poland with its registered office in Łódź, 91-203 Łódź, ul. Wersalska 6, KRS 0000631053, for the implementation of the current recruitment process and for the future recruitment for a period of 6 months, in accordance with the Regulation of the European Parliament and of the Council (EU) 2016/679 of 27 April 2016 on the protection of individuals with regard to the processing of personal data the free flow of such data and the repeal of Directive 95/46 / EC (RODO) and in accordance with the Act of 10 May 2018 on the protection of personal data (Journal of Laws of 2018, item 1000). I provided my personal data voluntarily and I declare that they are truthful. I have the right to withdraw this consent at any time. The withdrawal of consent shall not affect the lawfulness of processing based on consent before its withdrawal.
2. I have read the content of the information clause, including information about the purpose and methods of processing personal data and the right to access my personal data and about the right to correct, rectify and delete it.