Lead Software Engineer - Enterprise Data Warehouse (Information Technology)
Publix Super Markets, Inc. is the largest privately-owned food retailer in the nation with more than 1,200 stores and more than 200,000 associates throughout the Southeast. We are associate-owned, proud of our family atmosphere, and consistently named as one of the best companies to work for in America. We are largely debt-free and renowned for our financial performance as well as our premier customer service. Publix's Information Services (I/S) department is located in Lakeland, Florida and Alpharetta, Georgia and employs over 1000 associates. I/S provides the information technology required for all Publix business units including retail stores and all office and warehouse environments. The Publix I/S mission is to maximize the value of information technology to Publix associates and customers.
Please note, this is a hybrid position requiring 8 days per month on-site in Lakeland, FL.
Welcome to Publix Technology, the award-winning technical group for Publix Super Markets, Inc., the largest employee-owned company in the nation. Our technology teams of 2100+ associates provide cutting-edge, modern solutions to nearly 1400 retail stores and 200,000+ internal team members across 8 states. We offer positions at all levels - summer internships, individual contributor roles, to technical leadership across a broad range of technical disciplines. So, whether you are interested in IT security, platform engineering, architecture, software development, or infrastructure - we have a career path for you! Pub Subs are not the only thing we build from scratch. See for yourself why Publix Super Markets, Inc. has been on Fortune's 100 Best Companies to Work For list.
Join the Enterprise Data Warehouse team in Publix Technology. This team is responsible for leveraging the Publix Analytics stack with production workloads running in various timeframes. This team utilizes the analytics platform to support data-driven decision-making and enables business areas to use all capabilities of the Publix Data Analytics Strategy.
Job Responsibilities:
- Participate in Enterprise Data Warehouse and business application team projects with a focus on gathering requirements, design, development, and implementation of large-scale Big Data Cloud solutions
- Collaborate with the EDW team, Data Architects, DBAs, and application team developers to deliver large-scale Big Data solutions
- Participate in team reviews of ETL design artifacts and code, recommend changes as needed, and recommend alternative solutions where appropriate
- Coordinate with Release Management to plan and prepare testing environments and data seeding on a project-by-project basis
- Follow established processes for configuration and release management to ensure that all project artifacts are managed, integrated, and versioned according to standards
- Provide project status and translate technical concepts/issues to senior management
- Follow Agile methodology
- Provide afterhours support of the application once in the production environment
#LI-JB1
- Bachelor's degree in Computer Science or other analytical discipline or equivalent experience
- 7+ years of experience designing, developing, and supporting applications in an enterprise environment
- 5+ years of experience using AWS, GCP, or Azure cloud computing technologies
- 2+ years of data engineering experience with Databricks, Spark for batch and streaming, Python, SQL or relational databases, and data pipeline management
- 1+ year of hands-on experience with Snowflake platform
- 1+ year experience as a ETL Developer with IBM DataStage, or other ETL tools
- In-depth knowledge of Model and Design of DB schemas for read and write performance
- Experience tuning Databricks and Snowflake processes
- Experience with DevOps Integration, DevOps Pipelines, or other CI/CD tools
- Experience working in a data lake environment managing structured and unstructured data, leveraging data streaming, and developing data pipelines driven by events/queues
- Experience building processes supporting data transformation, data structures, metadata, dependency, and workload management
- Knowledge of Azure Data Lake and Data Lake Analytics
- Experience with Python, C#, Scala, or Java
- Experience with Kafka, Azure Event Hubs (or similar tech), or any other large-scale streaming technologies
- Experience with Machine Learning and Data Science algorithms
- Experience with Spark optimization and SQL Optimization
- Experience with Power BI
- Experience in designing large scale Distributed applications that are batch, micro-batch, and real-time
- Experience with sourcing on-prem data into the cloud and persisting the data for scalability
- Experience with data partitioning, compaction, and open-source file formats like Parquet and Delta
- Employee stock ownership plan that contributes Publix stock to associates each year at no cost
- An opportunity to purchase additional shares of our privately-held stock
- 401(k) retirement savings plan
- Group health, dental and vision plans
- Paid Time Off
- Paid Parental Leave
- Short- and long-term disability insurance
- Tuition reimbursement
- Free hot lunches (buffet-style) at facilities with a cafeteria
- Visit our website to see all of our benefits: Benefits - Jobs (publix.com)
