7EPKRVP62RMJN7T5SRPIPJD3KV432TAC7JOZXI4ABP7PTTE2TIAAC mark certainty=0 forCheck │ rqwTDv3Op63kDon't Know │ e-bBi7tasfyaQuestion │ lR6WEIWL5CUEmark certainty = 100 for│ Fake Kiwi │ -6ghUwAPNQ2J ││ Haast Tokoeka │ ANhV8iZPfIh8 ││ Kiwi │ 7LNNjRcptMev ││ Korero Gecko │ YPFfCCNvDuuK ││ Rowi │ fDGmXv9c6xEn ││ S. Fiordland Tokoeka │ jqEQrViqRFFX │mark all call types 100 certaincheck bulk import gets stdout, stderr right(base) skraak ➤ ./skraak import bulk --db ./db/skraak.duckdb --dataset la-JpAf2nLKG --csv "/media/david/Misc-2/Manu o Kahurangi kiwi survey (10)/NEW - MOK kiwi survey 20260306/import.csv" --log "/media/david/Misc-2/Manu o Kahurangi kiwi survey (10)/NEW - MOK kiwi survey 20260306/bulk_import.log"Starting bulk import...Database: ./db/skraak.duckdbDataset: la-JpAf2nLKGCSV: /media/david/Misc-2/Manu o Kahurangi kiwi survey (10)/NEW - MOK kiwi survey 20260306/import.csvLog: /media/david/Misc-2/Manu o Kahurangi kiwi survey (10)/NEW - MOK kiwi survey 20260306/bulk_import.logMonitor progress: tail -f /media/david/Misc-2/Manu o Kahurangi kiwi survey (10)/NEW - MOK kiwi survey 20260306/bulk_import.log{"total_locations": 39,"clusters_created": 39,"clusters_existing": 0,"total_files_scanned": 24590,"files_imported": 24583,"files_duplicate": 1,"files_error": 6,"processing_time": "1h49m40.555152942s"}
# prepare .data files for import skillget summarylook at species and call typescheck they match dbgenerate a dated json call mapping# import segments cmdoperates on 1 folderget list of files with segmentscheck segments are validapply call mappinghash files using existing utillabel idwrite file hash to file metadata: "skraak_hash" : xxh64 hashwrite label id to label metadata: "skraak_label_id" : 21 using existing utilInvariants- operates on 1 folder- all certainty scores (for label label_subtype) must not be null- label_mapping.json is required and must validate (input .data => db species and calltype)- All file hashes in the import must already exist in db- All included files must have no existing labels in db- All labels and label_subtypes must already exist in species and call_type
we need to write a new skill. in order to import .data files from a folderinto the skraak db, we need to make sure the species and calltype map tolabel and label_subtype in the db (ie a valid species and for that speciescalltype). this involves running $skraak calls summarise --folder./recordings | jq 'del(.segments)' then mapping existing specier and calltypes to db species and call types, outputting json, with user input asrequired. As below. ie existing => db mapping{"Morepork": {"name": "morepo1"},"Kiwi": {"name": "sobkiwi1","calltypes": {"M": "Male","F": "Female","D": "Duet"}}}