The Australian Government Information Management Office (AGIMO) last week released the draft version of its Big Data Strategy issues paper, designed to help departments formulate their own big data strategy. While many government agencies already have large amounts of data to churn through, one intriguing prospect the paper raises is that agencies might acquire data from Google, Twitter and other online businesses to enhance their own analytical capabilities.
The suggestion comes partway through the paper:
Private sector organisations such as Google, Twitter and Facebook hold enormous data stores on Australian citizens and people across the world, and offer access to these on commercial terms. While needing to carefully consider the veracity of this data, it may be that agencies could consider using this data as part of big data analytics projects. The ethical, privacy and security implications of decisions such as these will need to be carefully considered.
At the AIIA Navigating Big Data conference last week, AGIMO first assistant secretary policy and planning division Glenn Archer argued that dealing with big data skills shortages would inevitably require industry co-operation. "We have a real problem in this country -- in fact on this planet -- in relation to the scarcity of talent, both in terms of ICT generally and specifically with big data," he said. "We also need to leverage the considerable skills and expertise that exist in the wider community. We do expect to look to engage quite actively with industry."
When it comes to sharing existing government data, security and privacy is again a major concern:
The public release of large machine-readable data sets, as part of the open government policy, could potentially provide an opportunity for unfriendly state and non-state actors to glean sensitive information, or create a mosaic of exploitable information from apparently innocuous data. This threat will need to be understood and carefully managed.
AGIMO is inviting comments on the draft version of the policy; hit up the link below if you want to offer your input.