RFI Joint Staff GFM Decision-Ready Data Products (Gold Tables) Services in the SIPRNet War Data Platform

Part I. Performance Work Statement (PWS) Title: GFM Decision-Ready Data Products (Gold Tables) Services in the SIPRNet War Data PlatformProgram: Department of War Federated Data Platform – War Data Platform (formerly Advana)Managed By: OSW Chief Data and Artificial Intelligence Office (CDAO)Environment: SIPRNet War Data Platform (WDP) 1.0 Purpose This PWS defines the requirements for contractor support to engineer, implement, and sustain a modernized, next-generation Global Force Management (GFM) data lifecycle within the SIPRNet War Data Platform (WDP). Transitioning away from legacy methodologies, the contractor shall apply modern Digital Engineering and DataOps best practices to accelerate the movement of GFM data from originating Authoritative Data Systems (ADS). To minimize development time and align with existing ecosystems, the contractor must leverage proven, deployed Government Off-The-Shelf (GOTS) and Commercial Off-The-Shelf (COTS) technologies, using a mix of cloud-native (e.g., serverless functions) and non-native architectures for optimal data pipeline automation. Operating within the WDP Lakehouse architecture, the contractor shall process GFM data from Bronze (raw, source-aligned ingestion) to Silver (cleaned, validated, and enriched data) layers. Crucially, the contractor will employ Advanced Data Modeling techniques to develop “Single Source of Truth” GFM Gold Tables. These Gold Tables must be architected to strictly align with Joint Fires Network (JFN) and Intelligence Community (IC) "Golden Objects" (Red and Blue Object Management) – highly refined, authoritative, and standardized version of data entities. To support advanced analytics and autonomy, the contractor shall use a diverse, multi-tool suite of Artificial Intelligence (AI) capabilities for data hygiene, conversion, and interpretation. The ultimate objective is to ensure all final GFM Gold Tables are delivered in a universally "AI-Ready State" – eligible for ingestion by any platform or model without vendor lock-in. Finally, all updates to data, scripts, and models must be executed using a Blue/Green deployment architecture to ensure continuous, zero-downtime availability for production applications supporting the GFM mission across the Department. 2.0 Background The Department of War Federated Data Platform is the War Data Platform (WDP), managed by OSW CDAO. WDP is a Federated Data Lakehouse environment that supports ingestion, transformation, storage, governance, analytics, BI, applications, APIs, ML models, and LLM-enabled capabilities across Department mission and enterprise domains. WDP organizes data using a Bronze/Silver/Gold architecture, in which Bronze preserves raw ingested source data, Silver provides cleaned and enriched data, and Gold provides highly curated, aggregated, business-ready data optimized for Department use cases. The Government requires contractor support to operationalize WDP capabilities on SIPRNet to create trusted GFM Gold Tables for Joint and Service communities in support of the GFM mission across the Department. 3.0 Scope The contractor shall: Establish repeatable processes for the end-to-end GFM data lifecycle in the WDP. Ingest GFM data from approved Joint and Service source systems as WDP Bronze Tables. Clean, validate, enrich, standardize, and align data as WDP Silver Tables. Curate, version, govern, and publish decision-ready WDP Gold Tables in an accessible location within WDP. Ensure availability of GFM Data in a common location where all GFM Gold Tables. All GFM Gold tables shall be connected to the WDP Data Catalog for downstream access, search, and consumption through approved WDP-native access patterns. Establish and execute a comprehensive Data Intelligence & Active Data Governance framework, including automated data quality monitoring, end-to-end data lineage, active metadata management, and process governance to ensure all GFM data products are trusted, auditable, and decision-ready. Execute continuous Data Requirements Engineering & Discovery to define target schemas in coordination with GFM stakeholders. Engineer AI Vectorization & Embedding Generation pipelines to convert GFM Gold Tables into AI-ready formats. Leverage existing WDP AI capabilities to accelerate mapping, profiling, alignment, anomaly detection, and documentation. Provide program management, training, sustainment, and operational support using Agile methodologies (e.g., SAFe, Scrum). Out of scope unless specifically authorized: Development of new WDP core platform capabilities. Modification of authoritative source systems. Delivery outside SIPRNet. 4.0 Definitions GFM Data: Global Force Management data supporting force structure, force sourcing, readiness, allocation, assignment, availability, directed readiness related operational decision-making and their associated assessments. Bronze Layer/Tables: Raw source data ingested as received, with source fidelity preserved. Silver Layer/Tables: Cleaned, validated, standardized, and enriched data derived from Bronze. Gold Tables: The most refined data asset in the WDP, representing a curated, consumption-ready, and mission-focused data product. It is designed for high-performance analytics and is the authoritative source for specific business domains or mission areas. Gold Tables must meet the following criteria: Schema Standards: Data is explicitly modeled into analytical schemas optimized for read performance, such as Star or Snowflake schemas, and strictly aligned with JFN/IC "Golden Objects" (Red and Blue Object Management). Storage & Performance: Stored in optimized Databricks Datalake format to support high-performance, low-latency analytical queries from tools like Power BI, Qlik, and Tableau, as well as AI/ML model training. Aggregation & Business Logic: Contains business-level or mission-level aggregated data, tailored for specific reporting requirements and analytical objectives. All transfor…