File and Data Storage
Engineering IT Shared Services' staff of technical professionals can provide a range of robust IT infrastructure services to meet the needs of the College. Engineering IT provides private data storage services for all faculty, staff and students within the Grainger College of Engineering.
If Engineering IT does not have or cannot provide the solution required for your project or workflow there are several other on-premise and cloud solutions available.
- Top Storage FAQs
- Additional Questions
- Storage Solutions (At-a-Glance)
- Private Files and Home Directories
- Data Migration or Transfer Tools
- List of Storage Solutions
- Funding Agency Repositories/Requirements
- What are Best Practices for Managing Data? (PDF)
Top Storage FAQs
Are you working with sensitive data?
Whether it's FERPA, HIPAA, CUI, or other sensitive data, your data needs to be handled safely and stored in secure repositories. If you're unsure that your data is sensitive contact your Primary Investigator and/or funding agency.
Do you have a 'Data Management Plan'?
Your funding agency may require one but regardless it's a best practice to think about the life cycle of your data, how it is obtained, organized, and retired are good starting discussion points.
How critical is data loss?
Many funding agencies require you to ensure that data is preserved, regardless, losing data can be a loss of significant time. Considering backup or disaster recovery options is generally worth the time and money.
There are other questions to consider when determining the appropriate storage option for your project, you can find some of them below.
If you would like to meet with someone to discuss your needs please email the Research Technology Facilitator, Ethan Conner (firstname.lastname@example.org).
- How large are the files/data sets are you working with?
- Does your project have external collaborators?
- How rapidly will your storage needs grow?
- Does your project require high performance or throughput computation?
Storage Solutions (At-a-Glance)
Disclaimer: A system listed as "Compliant" in our matrix for our case means that system follows best practices. Some cloud services will require additional configuration to adhere to individual policies. Additionally, for full compliance a self-assessment for client machines and processes is required.
A full-sized version of this matrix can be found here.
|On-Premise Solutions||Hybrid||Cloud Service Solutions|
|Engineering IT Storage||Research Storage as a Service (RSaaS)||Taiga & Granite||Nightingale||Illinois Data Bank||Open Storage Network||Azure Storage
|OneDrive for Business (Office 365)||U of I Box||Google Apps @ Illinois|
|Service Information||EngrIT Storage
Taiga & Granite
|Illinois Data Bank||The Open Storage Network||Introduction to Azure Storage||AWS @ Illinois||OneDrive for Business||U of I Box||Google Apps @ Illinois|
|Where to get email@example.comfirstname.lastname@example.orgemail@example.com||OSN's Slack Networkfirstname.lastname@example.orgemail@example.com||Tech Services Help Desk|
|Amount of storage provided per person||2023 Pricing Pending||$56.04/TB/Year
(Billed monthly, and chargeable to grants)
(External user pricing available)
|Nightingale:$10.54/TB/month||2 TB/year||1-50TB (Get an Allocation)||Azure has a pricing calculator available||Amazon S3 has tiered pricing for their storage||OneDrive at Illinois provides unlimited storage for individuals||Box at Illinois provides unlimited storage for individuals||Google Drive at Illinois provides unlimited storage for individuals|
|Amount of storage provided per team (group)||Storage allotments can scale based on needs of the research group||N/A||Determined by team that receives an allocation||Storage allotments can scale based on needs of the research group||OneDrive is part of Microsoft Teams and provides unlimited storage for teams||Box Shared Drive provides unlimited storage for teams||Google Team Drive provides unlimited storage for teams|
|Maximum size for a single file||Dependent on OS and File System||N/A||Taiga has a 1TB per 1.5Million inode limit||N/A||15 GB
(can ingest via Box)
|5TB||Upper limit depends on the Azure solution, their Blob Storage has a file size limit of 200 TB||5 TB
(AWS Multipart Upload)
maximum of 20,000 files per subfolder
maximum of 15,000 files per subfolder
maximum of 400,000 files per subfolder
|Approved for storing FERPA data||COMPLIANT||COMPLIANT||COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||COMPLIANT||NOT COMPLIANT|
|Approved for storing HIPAA data||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||COMPLIANT FOLDERS ARE AVAILABLE||NOT COMPLIANT|
|Approved for storing CUI data||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT||NOT COMPLIANT|
|Web Access||N/A||Web access and file transfer available through Globus||N/A||OSN Portal||Microsoft Azure||AWS @ Illinois||OneDrive for Business||U of I Box||Google Drive|
|Mobile Access||N/A||Mobile access available through Globus||Responsive design works on most devices||3rd party apps supporting S3||Azure Mobile App||AWS Console Mobile App||OneDrive for Business app||Box Apps||Google Drive Mobile App|
|Desktop Access||Can be mounted to Operating Systems via NFS or SMB||API available||Cyberduck Download||Many storage solutions through Azure has ability to mount via NFS or SMB||Creating a File Share for S3||OneDrive for Business Sync software||Download the Box Drive software from the Box website||Google Drive desktop software|
|Backup & Recovery||Available at cost
(2023 Pricing Pending)
|RSaaS Disaster Recovery (DR) Service
|Disaster Recovery software available on request||N/A||N/A||Cloud services are often replicated to different sites; where those sites are located is worth consideration when working with sensitive data.|
Private Files and Home Directories
Engineering IT provides home directories for faculty, staff, and students. Faculty and Staff are charged $79/TB/year, billed to the department. These private folders can be mounted as network drives.
Students can access their home directory storage through an Engineering Workstation Lab computer or via the Citrix application.
Data Migration or Transfer tools
List of Storage Solutions
- Engineering IT can help design tailored solutions around project requirements.
- Taiga & Granite
- Research Storage as a Service (RSaaS)
- Illinois Data Bank
- Azure Storage
- Amazon Web Services (AWS)
- Office 365
- U of I Box
- Amazon Glacier
Funding Agency Repositories/Requirements
In August 2022, the White House Office of Science and Technology Policy (OSTP) updated their policy memorandum directing federal agencies to develop policies to make the publications and data resulting from federally funded research freely available to the public. Each funding agency may have specific requirements that could influence data access and storage decisions. More detailed information about funding agency requirements can be found at the links below.