{"id":2537,"date":"2021-11-10T18:59:27","date_gmt":"2021-11-10T17:59:27","guid":{"rendered":"https:\/\/dev.littlebigcode.fr\/cas-client\/conception-du-data-hub-et-implementation\/"},"modified":"2021-11-17T10:09:42","modified_gmt":"2021-11-17T09:09:42","slug":"conception-datahub-implementation","status":"publish","type":"cas-client","link":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/","title":{"rendered":"Conception of Data Hub and implementation"},"content":{"rendered":"<style>\nh3 {color : #1CACE4}<br \/><\/style>\n<h3><strong>Context and problematic<\/strong><\/h3>\n<p><\/p>\n<p>Resumption of a complicated context that exists, with a lot of abortive initiative.<br \/>\nWe had to allow Transdev to regain control of their data by centralizing the latter in one place, but most of all, convince the businesses and management of the contribution of these technologies.<br \/>\nWe had a first batch of 8 use cases to bring concrete results.<br \/>\nInitially, we focused on pilot projects with Quick-Win. Subsequently, we intervened in a more global way on all Data subjects.<\/p>\n<p><\/p>\n<h3><strong>Goals<\/strong><\/h3>\n<p><\/p>\n<p>Definition of the Data strategy<br \/>\nSupport the customer on the centralization and enhancement of their Data through the creation of their DataHub (DataWarehouse).<br \/>\nIndustrialization of 5 BI use cases<br \/>\nDemonstrate the contribution of Data Sciences via 8 Uses-Cases<br \/>\nPreparation and support for a more global deployment<br \/>\nEstablish a Data-Driven and DevOps culture<\/p>\n<h3><\/h3>\n<p><\/p>\n<h3><strong>Our intervention<\/strong><\/h3>\n<p><\/p>\n<p><strong>Audit<\/strong><\/p>\n<ul>\n<li>State of maturity and knowledge of Data subjects\/culture<\/li>\n<li>Analysis and inventory of the technologies which are used<\/li>\n<li>Organize the architecture and typology of the various group databases in order to define a representative target scope<\/li>\n<li>IS impact study<\/li>\n<\/ul>\n<p><strong>Data Strategy\u2013 Definition and implementation <\/strong>:<\/p>\n<ul>\n<li>CDC writing for ETL publisher consultation<\/li>\n<li>Drafting the CDC to consult a system which makes it easy to host standard data<\/li>\n<li>Drafting of the CDC to consult Data Analysis tools<\/li>\n<li>Solution benchmark and pilot project launch with Dataiku<\/li>\n<\/ul>\n<p><strong>AMOA <\/strong>:<\/p>\n<ul>\n<li>Definition of use cases<\/li>\n<li>Definition of a target scope: business, infrastructure, etc<\/li>\n<li>Definition of the roadmap<\/li>\n<\/ul>\n<p><strong>Data Architecture \u2013 definition and conception of DataWarehouse  :<\/strong><\/p>\n<ul>\n<li>Infrastructure architecture through AWS<\/li>\n<li>Definition of the Data ecosystem<\/li>\n<li>Setting up the environment<\/li>\n<\/ul>\n<p><strong>Data Engineering \/ Big Data development:<\/strong><\/p>\n<ul>\n<li>Development and industrialization of ingestion pipelines under Spark and Scala<\/li>\n<li>BI architecture: development and implementation of BI modules for 5 user-cases<\/li>\n<li>Industrialization of models in Python and Scala<\/li>\n<li>DevOps: Implementation of the ecosystem and related practices<\/li>\n<\/ul>\n<p><strong>Architecture BI: development and implementation of BI modules for the 5 User-Cases :<\/strong><\/p>\n<ul>\n<li>Analysis of business requirements<\/li>\n<li>Mapping of data and repositories<\/li>\n<li>Setting up the BI ecosystem: Power BI and Tableau<\/li>\n<\/ul>\n<p><strong>Data Analysis and Data Visualization: development and deployment of User-Cases :<\/strong><\/p>\n<ul>\n<li>Scorecard Matrix: Drivers and Manager<\/li>\n<li>Providing drivers and their managers with key indicators to trigger operational responses, properly manage individual performance and improve the company&#8217;s performance through its relationship with AOs.<\/li>\n<li>User case 2 : visualization of network traffic depending on the theoretical offer and the various services offered to travelers.<\/li>\n<li>Management Dashboard : provision of homogeneous indicators to operational managers and COMEX, which enables operational responses that need to be triggered, limiting the reporting burden in terms of the entity, by improving data quality (standardization of definitions, harmonization of benchmarks\u2026).<\/li>\n<\/ul>\n<\/ul>\n<p><strong>Data Sciences: development and industrialization of models :<\/strong><\/p>\n<ul>\n<li>Incident Classification (NLP and Time Series) : automatic incident analysis and classification. Prediction on the average resolution time.\n<li>Predictive maintenance (Time Series) : prediction of the failure rate on Bus type rolling stock<\/li>\n<li>License plate detection and reading (Computer Vision): identify return buses to the warehouse<\/li>\n<li>Sentiment analysis: analysis of social networks to pinpoint issues. Analysis of satisfaction questionnaires<\/li>\n<li>Churn : analysis and definition of patterns on potentially churning clients<\/li>\n<\/ul>\n<p><\/p>\n<h3><strong>Results<\/strong><\/h3>\n<p><\/p>\n<p>Operational DataHub for the entire target scope 4 DashBoards put into production instead of the 5 which were planned<br \/>\n7 Data Sciences User-Cases are deployed<\/p>\n<p><\/p>\n<h3><strong>Technical environment<\/strong><\/h3>\n<p><\/p>\n<p>AWS &#8211; SnowFlakes &#8211; Talend &#8211; Python &#8211; Scala &#8211; Spark &#8211; Docker &#8211; ElasticSearch &#8211; Keras TensorFlow &#8211; PyTorch &#8211; Tableau &#8211; PowerBI &#8211; Dataiku<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Context and problematic Resumption of a complicated context that exists, with a lot of abortive initiative. We had to allow Transdev to regain control of their data by centralizing the latter in one place, but most of all, convince the businesses and management of the contribution of these technologies. We had a first batch of [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":1623,"comment_status":"closed","ping_status":"open","template":"","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":""},"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.7.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Conception of Data Hub and implementation | LittleBigCode.fr<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Conception of Data Hub and implementation | LittleBigCode.fr\" \/>\n<meta property=\"og:description\" content=\"Context and problematic Resumption of a complicated context that exists, with a lot of abortive initiative. We had to allow Transdev to regain control of their data by centralizing the latter in one place, but most of all, convince the businesses and management of the contribution of these technologies. We had a first batch of [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/\" \/>\n<meta property=\"og:site_name\" content=\"LittleBigCode.fr\" \/>\n<meta property=\"article:modified_time\" content=\"2021-11-17T09:09:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/dev.littlebigcode.fr\/wp-content\/uploads\/2021\/06\/cas1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"450\" \/>\n\t<meta property=\"og:image:height\" content=\"704\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/\",\"url\":\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/\",\"name\":\"Conception of Data Hub and implementation | LittleBigCode.fr\",\"isPartOf\":{\"@id\":\"https:\/\/dev.littlebigcode.fr\/#website\"},\"datePublished\":\"2021-11-10T17:59:27+00:00\",\"dateModified\":\"2021-11-17T09:09:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/dev.littlebigcode.fr\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Conception of Data Hub and implementation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/dev.littlebigcode.fr\/#website\",\"url\":\"https:\/\/dev.littlebigcode.fr\/\",\"name\":\"LittleBigCode.fr\",\"description\":\"AI Solution Creator\",\"publisher\":{\"@id\":\"https:\/\/dev.littlebigcode.fr\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/dev.littlebigcode.fr\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/dev.littlebigcode.fr\/#organization\",\"name\":\"LittleBigCode\",\"url\":\"https:\/\/dev.littlebigcode.fr\/\",\"sameAs\":[\"https:\/\/www.linkedin.com\/company\/littlebigcode\/\",\"https:\/\/www.youtube.com\/channel\/UCTEax-7nR6n2zzgL4bz3fWQ\",\"https:\/\/medium.com\/hub-by-littlebigcode\"],\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/dev.littlebigcode.fr\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/dev.littlebigcode.fr\/wp-content\/uploads\/2021\/08\/Logo-LBC-AISC-format-carre\u0301.png\",\"contentUrl\":\"https:\/\/dev.littlebigcode.fr\/wp-content\/uploads\/2021\/08\/Logo-LBC-AISC-format-carre\u0301.png\",\"width\":768,\"height\":768,\"caption\":\"LittleBigCode\"},\"image\":{\"@id\":\"https:\/\/dev.littlebigcode.fr\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Conception of Data Hub and implementation | LittleBigCode.fr","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/","og_locale":"en_US","og_type":"article","og_title":"Conception of Data Hub and implementation | LittleBigCode.fr","og_description":"Context and problematic Resumption of a complicated context that exists, with a lot of abortive initiative. We had to allow Transdev to regain control of their data by centralizing the latter in one place, but most of all, convince the businesses and management of the contribution of these technologies. We had a first batch of [&hellip;]","og_url":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/","og_site_name":"LittleBigCode.fr","article_modified_time":"2021-11-17T09:09:42+00:00","og_image":[{"width":450,"height":704,"url":"https:\/\/dev.littlebigcode.fr\/wp-content\/uploads\/2021\/06\/cas1.png","type":"image\/png"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/","url":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/","name":"Conception of Data Hub and implementation | LittleBigCode.fr","isPartOf":{"@id":"https:\/\/dev.littlebigcode.fr\/#website"},"datePublished":"2021-11-10T17:59:27+00:00","dateModified":"2021-11-17T09:09:42+00:00","breadcrumb":{"@id":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/dev.littlebigcode.fr\/en\/cas-client\/conception-datahub-implementation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/dev.littlebigcode.fr\/en\/"},{"@type":"ListItem","position":2,"name":"Conception of Data Hub and implementation"}]},{"@type":"WebSite","@id":"https:\/\/dev.littlebigcode.fr\/#website","url":"https:\/\/dev.littlebigcode.fr\/","name":"LittleBigCode.fr","description":"AI Solution Creator","publisher":{"@id":"https:\/\/dev.littlebigcode.fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/dev.littlebigcode.fr\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/dev.littlebigcode.fr\/#organization","name":"LittleBigCode","url":"https:\/\/dev.littlebigcode.fr\/","sameAs":["https:\/\/www.linkedin.com\/company\/littlebigcode\/","https:\/\/www.youtube.com\/channel\/UCTEax-7nR6n2zzgL4bz3fWQ","https:\/\/medium.com\/hub-by-littlebigcode"],"logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/dev.littlebigcode.fr\/#\/schema\/logo\/image\/","url":"https:\/\/dev.littlebigcode.fr\/wp-content\/uploads\/2021\/08\/Logo-LBC-AISC-format-carre\u0301.png","contentUrl":"https:\/\/dev.littlebigcode.fr\/wp-content\/uploads\/2021\/08\/Logo-LBC-AISC-format-carre\u0301.png","width":768,"height":768,"caption":"LittleBigCode"},"image":{"@id":"https:\/\/dev.littlebigcode.fr\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/cas-client\/2537"}],"collection":[{"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/cas-client"}],"about":[{"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/types\/cas-client"}],"author":[{"embeddable":true,"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/comments?post=2537"}],"version-history":[{"count":0,"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/cas-client\/2537\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/media\/1623"}],"wp:attachment":[{"href":"https:\/\/dev.littlebigcode.fr\/en\/wp-json\/wp\/v2\/media?parent=2537"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}