Data Architect-BigData, Hadoop, Python, Pyspark
About the position Responsibilities • Act as an internal consultant for other data engineering and technical teams to enhance and optimize the quality of their code, ensuring adherence to engineering best practices. • Proven data literacy skills to describe business outcomes, data uses, data sources, and their management concepts and analytical approaches to all organizational levels in both business and technology. • Demonstrate initiative to develop approaches to solutions as part of a team; Review architecture and identify areas for automation, optimization, right-sizing, and cost reduction to support health of the environment. • Design, build and test data integration processes between business-critical applications to solve complex problems within financial services. • Define and implement internal process improvements through the development of detailed analytics that provide actionable insights into key business performance metrics • Designs, develops and optimizes data warehouses, with flexible and scalable data and ETL architecture, to support business users and Business Intelligence (BI) applications. • Analyzes business intelligence data and makes recommendations for data warehouse growth and integration an application/business function. • Works with IT and business customers to capture requirements for designing the data warehouse architecture. • Provides support and technical guidance to ensure the solutions are aligned with the architecture and framework. • Leads and consults on the implementation and integration of data warehouses; ensures the solution meets organizational quality and integrity standards. Requirements • Extensive experience with big data technologies and distributed computing tools (Hadoop, Spark, Hive Kafka, etc.) • Strong proficiency in relevant programming languages such as Python, PySpark, Spark, SQL • Proficient in Containerization (OpenShift, Kubernetes, Docker, etc.) • Experience with public cloud platforms - Apache Ice-burg and AWS - S3 • Knowledge of Unix/Linux shell scripting • Roles at this level typically require a university / college degree, with 5+ years of industry-relevant experience. Specific certifications are often required. In lieu of a degree, a comparable combination of education, job specific certification(s), and experience (including military service) may be considered. Nice-to-haves • Competitive Advantages • Customer Solutions • Design • Enterprise Architecture Framework • Machine Learning • Risk Assessments • Technical Knowledge Benefits • PNC offers a comprehensive range of benefits to help meet your needs now and in the future. Depending on your eligibility, options for full-time employees include: medical/prescription drug coverage (with a Health Savings Account feature), dental and vision options; employee and spouse/child life insurance; short and long-term disability protection; 401(k) with PNC match, pension and stock purchase plans; dependent care reimbursement account; back-up child/elder care; adoption, surrogacy, and doula reimbursement; educational assistance, including select programs fully paid; a robust wellness program with financial incentives. • In addition, PNC generally provides the following paid time off, depending on your eligibility: maternity and/or parental leave; up to 11 paid holidays each year; 8 occasional absence days each year, unless otherwise required by law; between 15 to 25 vacation days each year, depending on career level; and years of service. Apply tot his job Apply tot his job