Big Data Architecture 3117064

  • Company:
    Morgan Stanley
  • Location:
  • Salary:
    negotiable / monthly
  • Job type:
    Full-Time
  • Posted:
    1 week ago
  • Category:
    IT & Software

Company Profile Morgan Stanley is a global financial services firm and a market leader in investment banking, securities, investment management and wealth management services. With offices in more than 43 countries, the people of Morgan Stanley are dedicated to providing our clients the finest thinking, products and services to help them achieve even the most challenging goals. As a market leader, the talent and passion of our people is critical to our success. We embrace integrity, excellence, team work and giving back. Technology The Technology division partners with our business units and leading technology companies to redefine how we do business in ever more global and dynamic financial markets. Our sizeable investment in technology results in leading-edge tools, software, and systems. Our insights, applications, and infrastructure give a competitive edge to clients’ businesses—and to our own. Enterprise Technology & Risk (ETR) is comprised of five primary areas: – Core Infrastructure (CI) manages the infrastructure technology solutions to support the Firm’s daily operations, enable our businesses to expand to new markets, offer new client products, and comply with evolving regulations. – End User Technology (EUT) delivers core communication, collaboration and productivity tools across the Firm, including desktop and mobile devices, remote computing solutions, and multimedia services. – Quality Assurance & Production Management (QAPM) provides production management, quality assurance, and end user services for Institutional Securities and Support Services. QAPM also manages the Enterprise Command Center, Enterprise Systems Management, and Technology Disaster Recovery services. – Technology & Information Risk (TIR) delivers first-line defenses to manage risks to Firm technology. TIR oversees programs that protect and enable the business, ensure secure delivery of services to our clients, address the risks presented by an evolving threat landscape, and meet regulatory expectations. – Technology Business Development (TechBD) manages the Firm’s strategic relationships with external technology companies. Position Description: This position is with the Technology Assets Inventories (TAI) group, part of the Enterprise System Management (ESM) department. TAI is responsible for a set of systems used to manage Morgan Stanley’s IT inventory and assets data, together with their configuration and operational state. This data is critical for regulatory, operational, and efficiency purposes. Our goals are: – Sourcing IT inventory and machine data (e.g. logs, alerts) in a timely manner. – Storing the data in scalable repositories – Providing analytics tools to analyze and derive insights from the data. – Providing data access APIs so that other applications can consume the data and insights. We are looking for a seasoned hands-on Hadoop architect, to lead the design and development of a Hadoop data lake. The data lake will consolidate IT inventory and machine data from hundreds of sources. The data lake will be used to analyze this data and to feed downstream data marts. Company Profile Morgan Stanley is a global financial services firm and a market leader in investment banking, securities, investment management and wealth management services. With offices in more than 43 countries, the people of Morgan Stanley are dedicated to providing our clients the finest thinking, products and services to help them achieve even the most challenging goals. As a market leader, the talent and passion of our people is critical to our success. We embrace integrity, excellence, team work and giving back. Technology The Technology division partners with our business units and leading technology companies to redefine how we do business in ever more global and dynamic financial markets. Our sizeable investment in technology results in leading-edge tools, software, and systems. Our insights, applications, and infrastructure give a competitive edge to clients’ businesses—and to our own. Enterprise Technology & Risk (ETR) is comprised of five primary areas: – Core Infrastructure (CI) manages the infrastructure technology solutions to support the Firm’s daily operations, enable our businesses to expand to new markets, offer new client products, and comply with evolving regulations. – End User Technology (EUT) delivers core communication, collaboration and productivity tools across the Firm, including desktop and mobile devices, remote computing solutions, and multimedia services. – Quality Assurance & Production Management (QAPM) provides production management, quality assurance, and end user services for Institutional Securities and Support Services. QAPM also manages the Enterprise Command Center, Enterprise Systems Management, and Technology Disaster Recovery services. – Technology & Information Risk (TIR) delivers first-line defenses to manage risks to Firm technology. TIR oversees programs that protect and enable the business, ensure secure delivery of services to our clients, address the risks presented by an evolving threat landscape, and meet regulatory expectations. – Technology Business Development (TechBD) manages the Firm’s strategic relationships with external technology companies. Position Description: This position is with the Technology Assets Inventories (TAI) group, part of the Enterprise System Management (ESM) department. TAI is responsible for a set of systems used to manage Morgan Stanley’s IT inventory and assets data, together with their configuration and operational state. This data is critical for regulatory, operational, and efficiency purposes. Our goals are: – Sourcing IT inventory and machine data (e.g. logs, alerts) in a timely manner. – Storing the data in scalable repositories – Providing analytics tools to analyze and derive insights from the data. – Providing data access APIs so that other applications can consume the data and insights. We are looking for a seasoned hands-on Hadoop architect, to lead the design and development of a Hadoop data lake. The data lake will consolidate IT inventory and machine data from hundreds of sources. The data lake will be used to analyze this data and to feed downstream data marts. Your responsibilities will be: – Help define and lead the development of a state of the art data lake platform. – Own the delivery of the data lake platform. – Be the subject matter expert for Hadoop and its related ecosystem for the department. – Work closely with development managers and team leads regarding feeding/consuming data from the data lake. – Drive technical decisions and advise technical clients on usage of the data lake platform. – Mentor junior team members on data lake technologies and related ecosystem Qualifications: -10+ years’ of experience designing, architecting and deploying enterprise or commercial level systems -5+ years’ experience in big data platforms implementations, with at least 3 years of hands on experience implementing or performance tuning Hadoop or related platforms -Deep understanding of the Hadoop ecosystem and solid knowledge of Hadoop architectural components -High proficiency developing software in one or more programming languages Java/Scala/Python -Experience with Kafka or similar systems -Sound knowledge of Unix -Track record -Strong problem solving skills Knowledge of French and English are required. Morgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximize their full potential. Your responsibilities will be: – Help define and lead the development of a state of the art data lake platform. – Own the delivery of the data lake platform. – Be the subject matter expert for Hadoop and its related ecosystem for the department. – Work closely with development managers and team leads regarding feeding/consuming data from the data lake. – Drive technical decisions and advise technical clients on usage of the data lake platform. – Mentor junior team members on data lake technologies and related ecosystem Qualifications: -10+ years’ of experience designing, architecting and deploying enterprise or commercial level systems -5+ years’ experience in big data platforms implementations, with at least 3 years of hands on experience implementing or performance tuning Hadoop or related platforms -Deep understanding of the Hadoop ecosystem and solid knowledge of Hadoop architectural components -High proficiency developing software in one or more programming languages Java/Scala/Python -Experience with Kafka or similar systems -Sound knowledge of Unix -Track record -Strong problem solving skills Knowledge of French and English are required. Morgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximize their full potential.