OCN: DESM Tool: Difference between revisions

From T3 Network Wiki
No edit summary
 
(13 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[File:ocfcTool.png|200px]]
{{OCN_Navigation}} >> [[T3_Open_Competencies_Network|OC Network Home]] >> [[OCN: Technical Advisory Workgroup|TAW]] >>  ''Data Ecosystem Schema Mapper (DESM) Tool''


The Data Ecosystem Mapping (DESM) Tool is a specialized tool for creating, editing, maintaining and viewing crosswalks between data standards from two or more Data Standard Organizations (DSOs). These crosswalks are based on the degree of semantic alignment between terms in the different standards or schemas, and may be useful for: 


>> [[OCF_Collab_Network|'''OCFCollab Home''']] >> [[OCF_Collab_Network:TAW|'''TAW''']] >> ''DESM Tool''
* supporting translation of data from one standard to another,
* supporting the development of data models that align to several standards
* showing which standards cover what terms,


= Data Ecosystem Schema Mapper tool =
among other uses. These uses recognize the reality that any data ecosystem will encompass actors who use different data standards, different models and different schemas, because they have different interests, systems and requirements for the data. Data translation allows a degree of interoperability despite the use of data standards; however our ultimate hope is that semantic mapping will show that data harmonization is possible, that is that different data standards can share semantics and models for common elements.
The Data Ecosystem Schema Mapper (DESM) is a powerful tool for creating data schema crosswalks that can be used by the OCF Collab member nodes in transposing schemas and by others for other purposes. The DESM is being developed via an open license.


Development of the Configuration Dashboard is in process now.  Follow development via the T3 [https://github.com/t3-innovation-network/desm DESM Github Repo].
The crosswalks are based on pairwise mapping of terms from the different standards to a "synthetic spine", a schema-neutral synthesis terms that is created during the mapping. Mappings from terms in one standard to terms in another can then be inferred where their respective mappings to the spine are transitive.


== Resources ==
== Resources ==


* Short Prototype DESM Tool [https://drive.google.com/file/d/1__yBYRhOWrIrC2HUbkYsw2GU3Vj8DixM/view?usp=sharing Demonstration Video]
* July 19, 2023: [https://docs.google.com/presentation/d/1eNVAWpjPeFoNQvQKEWdLrOYvPVh6JLEOZkuAEQjRwLY/edit?usp=sharing Unlocking Data Ecosystems: DESM and Competency Explorer T3 Mid-year Meeting Slides]
* April 6, 2023: [https://drive.google.com/file/d/1C_wsTKpbtV6zLgk3squtXrqwTsr6pg1j/view?usp=sharing DESM Pilot Report April 6, 2023] (and a short [https://docs.google.com/document/d/1z11oZvgAsUBsJgVnf4-cPlG5ZzwxVZqdRB1u_qzd_N0/edit?usp=sharing addendum] on using the exported mapping files)
*[https://github.com/t3-innovation-network/desm DESM GItHub Repository]
*September 2022: [https://www.youtube.com/watch?v=VjQwhq1_hQ8 demo of DESM Tool] (Featuring Joe Baird)
*Short Prototype DESM Tool [https://drive.google.com/file/d/1__yBYRhOWrIrC2HUbkYsw2GU3Vj8DixM/view?usp=sharing Demonstration Video]
*[https://docs.google.com/presentation/d/1CdWynmjq_SMLzUJzGcCLAzHQJqn8afLlk-P0BVT8REY/edit?usp=sharing Introduction to the Data Ecosystem Schema Mapper Tool Slides]
*[https://docs.google.com/presentation/d/1CdWynmjq_SMLzUJzGcCLAzHQJqn8afLlk-P0BVT8REY/edit?usp=sharing Introduction to the Data Ecosystem Schema Mapper Tool Slides]
*[https://docs.google.com/document/d/1jxaGNJQThHGO004Hpek18A0qubb8Osbew23IuSKkSHo/edit ''2020-21 DESM Agenda & Notes'']
*[https://docs.google.com/document/d/1jxaGNJQThHGO004Hpek18A0qubb8Osbew23IuSKkSHo/edit ''2020-21 DESM Agenda & Notes'']
Line 17: Line 23:


== DESM Tool Technical Documentation ==
== DESM Tool Technical Documentation ==
:* [https://github.com/t3-innovation-network/desm DESM Github Repo]  [https://github.com/t3-innovation-network/desm#readme DESM Admin Documentation (draft)]  
:* [https://github.com/t3-innovation-network/desm DESM Github Repo]   
:*[https://github.com/t3-innovation-network/desm/wiki/1-Logging-In DESM Instruction Wiki]
:*[https://github.com/t3-innovation-network/desm#readme DESM Admin Documentation (draft)]  
 
== DESM Tool Pilot Plan ==
The DESM Tool was tested by invited data standard organizations between November 2022 and February 2023.  Participating DSOs were the first users of the DESM tool.  The pilot was aimed at ensuring its functionality works as intended;  identifying usability issues; validating utility of output; getting input on sustainability and building support for DSOs using DESM to share mappings.  The pilot focused on mappings to support aspects of the Skills-based Hiring and Career Advancement Use Cases developed by the T3, Job and Workforce Data Network.  The use cases can be reviewed in the [https://assets.website-files.com/62d09b4cd38ec93ebb6738a2/632b36748d53966145c85164_22-12095_USCCF_T3InnovationNetworkExplainer_Booklet_ViewOnly.pdf T3 Skills-Based Hiring and Advancement Project Report].
 
* [https://drive.google.com/file/d/1C_wsTKpbtV6zLgk3squtXrqwTsr6pg1j/view?usp=sharing DESM Pilot Report April 6, 2023]
*[https://docs.google.com/document/d/1N1j27KcidGxJSpieJuNR-9bSoQLNgMtUfY7BCPtsiRM/edit?usp=sharing DESM Pilot Plan]
 
==''OCFC:PP-001:'' Develop DESM Project Configuration Dashboard==
==''OCFC:PP-001:'' Develop DESM Project Configuration Dashboard==
[https://docs.google.com/document/d/19NBW3_fPOVtkYsyqZfcrqWtV_eNSyQnGFJBxuYYFZ-w/edit?usp=sharing '''OCFC:PP-001 Working Document''' (Approved and Funded)]
[https://docs.google.com/document/d/19NBW3_fPOVtkYsyqZfcrqWtV_eNSyQnGFJBxuYYFZ-w/edit?usp=sharing '''OCFC:PP-001 DESM Configuration Dashboard Project Plan''' (Approved and Funded)]


'''Project Description:''' This project plan defines work to be done in implementing a configuration dashboard for the Data Ecosystem Mapper (DESM) tool  to facilitate the setup of the configuration profile by schema mapping leads. The plan and document including wireframes for configuring the Tool for a particular mapping project was developed as part of the work of OCF Collab Phase 2 in 2020.
'''Project Description:''' This project plan defines work to be done in implementing a configuration dashboard for the DESM tool  to facilitate the setup of the configuration profile by schema mapping leads. The plan and document including wireframes for configuring the Tool for a particular mapping project was developed as part of the work of the Network Phase 2 in 2020.


'''Project Period:''' December 17, 2021 through May 31, 2022
'''Project Period:''' December 17, 2021 through May 31, 2022
Line 30: Line 45:
* August 31, 2022: Review skills-based hiring and career advancement use case and report and plans for enhancing and using DESM for standards gap analysis and alignment and harmonization and develop a work plan for enhancing and using DESM for the use case.
* August 31, 2022: Review skills-based hiring and career advancement use case and report and plans for enhancing and using DESM for standards gap analysis and alignment and harmonization and develop a work plan for enhancing and using DESM for the use case.
* December 30, 2022: Implement DESM enhancements and produce guidance materials for conducting gap analysis and standards alignment and harmonization.
* December 30, 2022: Implement DESM enhancements and produce guidance materials for conducting gap analysis and standards alignment and harmonization.
* March 15, 2023: Pilot-test the use of DESM in conducting gap analysis and standards alignment and harmonization for the skills-based hiring and career advancement use case and develop plan for sustaining the use of DESM in addressing other critical use cases.
* March 15, 2023: Complete pilot-test of the use of DESM in conducting gap analysis and standards alignment and harmonization for the skills-based hiring and career advancement use case and develop plan for sustaining the use of DESM in addressing other critical use cases.
==Internal Teams (Limited Access)==
==Internal Teams (Limited Access)==
:*[https://docs.google.com/document/d/16_-t7I-St8OjdJQeHfhfCP5SzgOXwjSH-h9dwkR1PIs/edit?usp=sharing ''DESM'']
:*[https://docs.google.com/document/d/16_-t7I-St8OjdJQeHfhfCP5SzgOXwjSH-h9dwkR1PIs/edit?usp=sharing ''DESM'']

Latest revision as of 14:36, 20 July 2023

>> OC Network Home >> TAW >> Data Ecosystem Schema Mapper (DESM) Tool

The Data Ecosystem Mapping (DESM) Tool is a specialized tool for creating, editing, maintaining and viewing crosswalks between data standards from two or more Data Standard Organizations (DSOs). These crosswalks are based on the degree of semantic alignment between terms in the different standards or schemas, and may be useful for:

  • supporting translation of data from one standard to another,
  • supporting the development of data models that align to several standards
  • showing which standards cover what terms,

among other uses. These uses recognize the reality that any data ecosystem will encompass actors who use different data standards, different models and different schemas, because they have different interests, systems and requirements for the data. Data translation allows a degree of interoperability despite the use of data standards; however our ultimate hope is that semantic mapping will show that data harmonization is possible, that is that different data standards can share semantics and models for common elements.

The crosswalks are based on pairwise mapping of terms from the different standards to a "synthetic spine", a schema-neutral synthesis terms that is created during the mapping. Mappings from terms in one standard to terms in another can then be inferred where their respective mappings to the spine are transitive.

Resources

DESM Tool Technical Documentation

DESM Tool Pilot Plan

The DESM Tool was tested by invited data standard organizations between November 2022 and February 2023. Participating DSOs were the first users of the DESM tool.  The pilot was aimed at ensuring its functionality works as intended;  identifying usability issues; validating utility of output; getting input on sustainability and building support for DSOs using DESM to share mappings.  The pilot focused on mappings to support aspects of the Skills-based Hiring and Career Advancement Use Cases developed by the T3, Job and Workforce Data Network.  The use cases can be reviewed in the T3 Skills-Based Hiring and Advancement Project Report.

OCFC:PP-001: Develop DESM Project Configuration Dashboard

OCFC:PP-001 DESM Configuration Dashboard Project Plan (Approved and Funded)

Project Description: This project plan defines work to be done in implementing a configuration dashboard for the DESM tool to facilitate the setup of the configuration profile by schema mapping leads. The plan and document including wireframes for configuring the Tool for a particular mapping project was developed as part of the work of the Network Phase 2 in 2020.

Project Period: December 17, 2021 through May 31, 2022

T3 DESM Project Plan: Development and Use of DESM for Data Standards Alignment and Harmonization

9-Month Milestone: 3-5 data standards organizations relevant to the skills-based hiring and advancement use case will commit to utilize the enhanced DESM tool for standards development, alignment, and harmonization to promote data interoperability and support leading practices and tools in skills-based hiring and career advancement and complete competency and skill mapping.

  • August 31, 2022: Review skills-based hiring and career advancement use case and report and plans for enhancing and using DESM for standards gap analysis and alignment and harmonization and develop a work plan for enhancing and using DESM for the use case.
  • December 30, 2022: Implement DESM enhancements and produce guidance materials for conducting gap analysis and standards alignment and harmonization.
  • March 15, 2023: Complete pilot-test of the use of DESM in conducting gap analysis and standards alignment and harmonization for the skills-based hiring and career advancement use case and develop plan for sustaining the use of DESM in addressing other critical use cases.

Internal Teams (Limited Access)