Data Management

Image of Data Flow

Data Regulation

  All data acquired and processed are owned and managed by corresponding users. The Wolfson Centre provides storage to facilitate image acquisition. We also apply data regulations published here to maintain the traffic of multi-user environment. We don't, however, take any responsibility to the safety and security of users data.

Data Safety
  • Users have full ownership and responsibility to the safety of their data.
  • Raw data should be initially saved in local drive during imaging, but should be moved to Remote Storage immediately after any experiment
  • Remote Storage is much safer than internal hard dirve, portable hard drive and flash drive, but can also fail
  • Valuable results should be saved in Safe Storage that has backup facility
  • Please check ITs backup for details
Useful Guidance
Routine Data Maintenance
  • Data older than 6 months in Local Storages will be removed during storage maintenance
  • Data older than 12 months in Remote Storage will be archived to tapes (setting up)
Data Recovery
  • Data in Local Storage will NOT be recoverable if hard drive fails or files are deleted by mistake
  • Data removed from Local Storage during the last storage maintenance may be recoverable
  • Data in Remote Storage will NOT be recoverable if the storage fails or files are deleted by mistake
  • Archived data from Remote Storage may be recovable. Please refer to ITs regulations for details
  • Data in Safe Storage are fully recoverable. Please refer to ITs regulations for details
Local Storage
  • Separate internal hard drive (name: Data) in the acquisition workstation of each microscope and offline workstation
  • Individual user directories but with no privilege
  • Users have full responsibility to their data
  • Hard drive can break at anytime
  • It is a good practice to copy your data to the Remote Storage immediately after an experiment
  • If your data is no longer userful, please help us to delete them. This is especially appreciated on Operetta
  • Data older than 6 months will be removed routinely during storage maintenance.
Remote Storage
Scratch
  • RAID 6 configuration (data are recoverable when less than two hard drive sub-units are broken at the same time)
  • Managed by ITs (Name: Scratch)
  • Accessibility
    • Access Path
      • From Windows PC: \\scratch.gdsc.sussex.ac.uk\scratch
      • From Mac: smb://scratch.gdsc/sussex.ac.uk/scratch
      • From LINUX: ssh to: @scratch.gdsc.sussex.ac.uk:/srv/scratch
    • Registered GDSC microscope user only
    • Permission from PI is required to setup user directory
    • List of groups using Scratch
  • Total capacity: 20TB
  • No daily backup or archive facility at moment
  • Accessible from all microscope/offline workstations and office computers
  • Data privilege applied
  • Suitable for short term storage
  • Group and individual user directory are setup via the Wolfson Centre
Danio
  • RAID 6 configuration (data are recoverable when less than two two hard drive sub-units are broken at the same time)
  • Managed by ITs (Name: Danio)
  • Accessibility
    • Access Path
      • From Windows PC
        • GDSC research groups: \\danio.uscs.sussex.ac.uk\gdsc-groups
        • The Wolfson Centre: \\danio.uscs.sussex.ac.uk\gdsc-microscopy
      • From Mac: smb://danio.uscs.sussex.ac.uk/gdsc-groups
    • Registered GDSC microscope user only
    • Permission from PI is required to setup user directory
    • List of groups using Danio
  • Total capacity: 40TB
  • Quota applies to each research group
  • No daily backup or archive facility at moment
  • Accessible from all microscope/offline workstations and office computers
  • Data privilege applied
  • Suitable for short term storage
  • Group and individual user directory are setup via the Wolfson Centre
Scampix
  • Daily backup configuration and regular tape archive facility
  • Managed by ITs (Name: Scampix), reviewed every five years
  • Accessibility
    • Access Path
      • From Windows PC: \\researchdata.uscs.sussex.ac.uk\scampix
      • From Mac: smb://researchdata.uscs.sussex.ac.uk/scampix
    • Registered user in the school except GDSC
    • Permission from PI is required to setup user directory
    • List of groups using Scampix
  • Total capacity: 4TB
  • Quota applies to each research group
  • Accessible from all microscope/offline workstations and office computers
  • Data privilege applied
  • Suitable for short term storage
  • Group and individual user directory are setup via the Wolfson Centre
Safe Storage
Omero
  • Image specified storage and data management system (files are invisible in Windows file management system)
  • Managed by ITs (Name: Omero)
  • Accessibility
    • Access Path
      • "\\GDSC\OMERO client\OMERO.insight_64.exe"
      • Website client: http://omero.lifesci.sussex.ac.uk/omero/webclient/
    • Registered GDSC user only
    • Permission from PI is required to setup user directory
    • List of groups using Omero
  • Total capacity: 10 TB
  • Daily backup
  • Accessible from all microscope computers, offline workstations and office computers
  • Data privilege applied
  • Suitable for long term storage
  • Group and individual user directory are setup via the Wolfson Centre
Research Volume (R:)
  • Daily backup
  • Managed by ITs with no association with microscope facility (Name: Research Directory)
  • Path: \\ad.susx.ac.uk\ITS\Research
  • Capacity and backup support are charged every five years
  • Accessible only if the research group has purchased certain capacity
  • Data privilege applied
  • Suitable for long term storage
  • Setup via ITs
Home Directory (N:)
  • Not designed for image storage but can be used to save final results
  • Managed by ITs (Name: Home Directory)
  • Fixed capacity (small for images)
  • Daily backup
  • Available automatically by everybody with an US account
  • Data privilege applied
  • Suitable for long term storage