Roger Montti writes that Google has released version 0.2 of the Open Knowledge Format, incorporating five trust signals to facilitate data verification for consumers. These updates cover provenance, generation and verification status, freshness via expiration dates, lifecycle stages, and computational attestation to address questions regarding a concept's origin, accuracy, and timeliness. By providing raw metadata rather than subjective credibility scores, Google enables users or agents to dynamically evaluate information based on objective signals such as authorship and usage counts.
- Attested Computation is a new type used to confirm that values are calculated using sanctioned methods instead of improvised logic.
- The "sources" field provides objective data points like author and last modified date rather than an inherent score.
- Verification can be performed by humans or machine agents, allowing users to filter content based on verification level.
This article explores the critical intersection of knowledge graphs and data lineage in the context of modern AI and machine learning. It examines how combining these two technologies can provide the transparency and traceability required to build trustworthy AI systems. By mapping the origins, transformations, and movements of data, organizations can ensure better data quality, regulatory compliance, and improved model interpretability.
MIT CSAIL Professor Hal Abelson emphasizes the importance of free software for securing our agency in our digital worlds. His project, App Inventor, enables anyone to create apps without coding. He also discusses free software freedoms, the book 'Blown to Bits', and the importance of privacy and data provenance in today's digital age.
Commercially supported by Union.ai, Flyte is a Kubernetes-friendly DAG-based data pipelining framework that can type check material that has been ingested as Data Frames in the Python Pandas format. And Pandera builds on this framework by also providing additional statistical and validations checks against data, allowing an organization build out a data schema that embeds some domain knowledge around the acceptable data ranges and types.
When used together these programs can validate data as correct, throwing out alerts at runtime when they are validated. In machine learning, type safety is vitally important if for no other reason than it can save considerable time and resources.