Databricks
databricks
Databricks - User Cases -Macnica
Databricks will serve as a company-wide data integration platform, including globally.
Macnica, which operates in the semiconductor, cybersecurity, and CPS (Cyber-Physical System) solutions sectors, had built a data integration platform within the data warehouse (DWH) of its core systems. However, due to performance issues, challenges in utilizing unstructured data, and the need to leverage AI, among other factors, there was an urgent need to establish a new, company-wide data integration platform that could be utilized globally.For this data integration platform, the company adopted Databricks—a data intelligence platform with advanced capabilities, including AI—as a highly scalable solution that addresses performance concerns associated with parallel processing.
the purpose
- To realize Vision 2030, we are promoting the construction of an IT ecosystem.
- We will integrate our core systems globally and build a company-wide data integration platform.
- We aim to maximize the data value chain by consolidating company-wide data.
Task
- The data analysis platform has limitations in scalability, and the cost of handling massive data increases is becoming exorbitant.
- Performance degradation due to the increase in data and users has reached a level that cannot be ignored, and is having an impact on business operations.
- The global integration of core systems necessitates a data integration platform that will lead to the creation of new added value.
effect
- Flexible scaling resolves performance issues and contributes to creating a system that can operate without change even if the amount of data doubles.
- Development efficiency is expected to dramatically improve, with projects that previously took a week now being completed in just one day.
- This marks the first step in developing an advanced data integration platform that goes beyond simple data visualization to enable prediction, action, and automation.
IT Division, DX Promotion Department
Head of Data Platform Department
Hiroyuki Miyaji
IT Division, DX Promotion Department
Data Platform Department
Data Engineering Department Manager
Naoki Shiragazawa
IT Division, DX Promotion Department
Data Platform Department
Data Engineering Department
Yasuaki Honji
Performance degradation due to increasing data and users is impacting business operations, making the development of a scalable data integration platform an urgent necessity.
Macnica, established in 1972, operates globally as a technology trading company specializing in semiconductors, electronic components, and network equipment. In addition to its semiconductor business, the company is active in cybersecurity and CPS solutions, embodying its corporate philosophy of “continuing to sow seeds at our feet” through the exploration of cutting-edge technologies.Currently, the company has adopted “Vision 2030,” which aims to “continue creating new value by connecting the world’s technology and knowledge to realize a prosperous future society” (Service & Solution Company). While taking on the challenge of developing new business models and advancing the societal implementation of “Cyber × Physical,” the company is focusing its efforts on activities that generate new surprises and reality through social contribution.
As part of its IT strategy steps toward realizing Vision 2030, the company is expanding its existing IT and digital environment and building an IT ecosystem that enables value creation through collaboration with various business and corporate departments. To develop this IT ecosystem, the company is consolidating, training, and utilizing IT and DX talent, building a global-level IT support system, and creating a global support framework that includes the consolidation and utilization of knowledge, know-how, and data assets.
Regarding data utilization, we had previously built an information infrastructure by using ETL tools and a DWH built on traditional on-premises systems, and by aggregating company-wide data through integration with accounting data and business systems. However, as the amount of data grew enormously, there was a constant need to expand server capacity, and the burden of scaling up while considering costs became significant. Because this DWH is used as part of daily operations, operational issues such as nighttime batch processing not completing due to performance degradation also became apparent," Miyaji recalls.
As challenges became apparent, the IT department needed to take the lead in integrating core systems scattered around the world to build a global IT ecosystem. This required the development of a data integration platform that could be expanded more flexibly than ever before. Performance issues had also been causing regular failures, making a migration to a new environment necessary.
Customer story 1st page sample
Inquiry/Document request
In charge of Macnica Databricks Co., Ltd.
- TEL：045-476-2010
- E-mail：databricks-sales@macnica.co.jp
Weekdays: 9:00-17:00