Civis Platform automatically deletes files hosted on S3 after a set timeframe, detailed below.
If you need continued access to an S3 file, you may download it to your local machine or extend its retention using the instructions below.
Civis Platform S3 File Retention Schedule
Data |
Description |
Length of Retention* |
Geocoder Error Files |
Diagnostic files available via run logs if error occurs when creating or populating the Geocoder output table. |
2 weeks |
Job Outputs |
Includes outputs attached to SQL Scripts, Imports, Exports, etc. |
30 days |
Query Preview Results |
Preview results found in the Query History side pane. |
30 days |
CASS/NCOA PDF Outputs |
Applies to success & failure PDF outputs produced by CASS/NCOA jobs. Does not apply to outputs delivered directly to a database table. |
30 days |
General Files |
Files uploaded to S3 using the /files API, including multi-part uploads. |
30 days |
* Unless custom expiration date supplied by user.
Extending File Retention
You can extend a file’s lifetime by updating its expiresAt timestamp via the patch file API. Civis encourages you to maintain these files only as long as necessary to achieve your business goals.
Example Python Script:
from datetime import datetime, timedelta
import civis
client = civis.APIClient()
new_expiration = datetime.now() + timedelta(days=3)
client.files.patch(file_id, expires_at=new_expiration.isoformat())
Comments
0 comments
Please sign in to leave a comment.