0
Skip Navigation | ANU Home | Search ANU | Directories | APAC National Facility
The Australian National University
ANU Supercomputer Facility
Printer Friendly Version of this Document

Image of Tape Robot

Data Services and Project support

Services Offered ANUSF supports projects with large data or data intensive requirements. The areas covered include
  • managing large or complex data repositories
  • Web portals and specialist tools
  • curation advice of data and metadata
  • grid technologies for remote access, transfer and replication of data
  • relational database management support
  • data mining and analysis
  • support for data workflows and pipelines linking to instruments or computational models
  • project tracking, auditing and performance advice
The facility manages a large mass data storage system which is an environment that supports many of these activities.

Through the facilities Vizlab there are related services for assistance with visualiation techniques for existing datasets.

Applying for a Project Projects which are requesting space and support on the system should do so by submitting a form with details about the project. Forms to apply for access are hosted on the APAC National Facility web pages. In particular, there is a request for a new project and a form for a variation for an existing project. Please note the access policy.

See existing ANU projects and datasets MDSS Usage.

Note that:

  • ANU researchers who have a new mass data only project not associated with a computational MAS or STAC project should fill out the 'For NEW data intensive project Form'. The question on that form about the national significance of the data-sets may be answered with the likes of 'Not Applicable'.
  • If you have just applied for a computational MAS or STAC project which has not yet been approved, please use the 'MAS and Partner Share Computational Projects Form' if you will require more than 20GB of storage. Ask us if you are unsure of the project code of the new project.
Consulting Support Projects dealing with massive amounts of data need to carefully consider all aspects of data acquisition, storage, retrieval, navigation, and interpretation. ANUSF consulting staff are available to assist projects in all phases of this cradle-to-grave process. Send email to help@anusf.anu.edu.au to make an appointment for an exploratory conversation. ANUSF staff are available for either short-term or long-term consultancies to assist with data management.
Data Storage System Details The Mass Data Storage System is the main infrastructure for managing data. The facility (more details) includes :
  • high speed network connection to AARNet and Grangenet
  • web, grid and other data transfer programs
  • large disk-resident high speed I/O filesystems in a unix environment
  • integrated deep archival facility through use of HSM filesystem management
  • various utilities for the transfer of data
  • clustered user accessible relational database support
  • programmer interfaces to manage data
  • Software available A range of software tools is available to assist with data problems, including access to database servers, network transfers, data formats, data analysis and repository management software. See our software list for details. If the list does not have the software you require then submit a software request form.
    Data Handling Techniques There are a range of technologies and techniques for working with large data.