Version comparison. Confluence's rendering of what changed between two versions of this page.
Recovered from the Internet Archive snapshot of
/pages/diffpagesbyversion.action?pageId=25887148&selectedPageVersions=2&selectedPageVersions=3
taken on 2013-08-01.
CSV listing of Aggregations of Duplicates in a Dataset
|
Key
This line was removed.
This word was removed. This word was added.
This line was added.
|
Changes (2)
View Page History
...This solution uses a Python (3.3) script to process a tab-delimited checksum file (checksum tab path) to create a CSV file listing every directory found with a file count and a duplicate file count. This allows a user to easily see where high concentrations of duplicates exist.
_Tip_: Open the CSV in a spreadsheet and add a column to display percent of duplication (dups/count) (add function to the field. =dups field / count field) to see degree of duplication for each directory.
The script started as an attempt to create the JSON data needed to feed a TreeMap visualization but was reduced in scope to this solution to fit time constraints.
...__[KB:Identifying Aggregations of Duplicates in a Dataset]
*Tool/code link*
_Link to GitHub forthcoming._
_Link to GitHub forthcoming._
...