Articles in this section

See more

Civis Platform Release Notes 2024

Avatar
Owen Harrington-Woodard
Updated
Follow

Week ending 12/14/2024

Updates

  • The Memory and CPU status bars on the Platform Usage Overview have been updated to show the sum of running and pending resource requests vs available resources, rather than just running resource requests vs available resources. This change should make identification of overloaded instance groups easier, highlighting situations where long queue times are likely.

Bug Fixes

  • Fixed issue where the Query Results pane was sometimes cut off early.
  • The “Salesforce Export” script template can now correctly export a BigQuery table whose column names have upper-case letters.

Help Articles Updated

Week Ending 11/23/2024

Updates

Help Articles Updated

Week Ending 11/16/2024

Updates

  • For the “Hubspot Import Contacts and Form Submissions” script template: The “Hubspot URI” parameter now accepts an API endpoint URL to import historical contact data.
  • Removed the LIMIT 10 clause from queries created by the “Query Table” buttons on the Data Pane and Table Details page.
  • Improved documentation for the /imports/{id}/syncs API endpoints.

Bug Fixes

  • Fixed “Import from S/FTP” and “Multi from S/FTP to Civis” script templates so that custom scripts from these two script templates can now successfully import data from the host “*.sharefileftp.com” for mode “FTP_TLS”.
  • Fixed issue preventing some Azure data types, namely NCHAR, NVARCHAR and UNIQUEIDENTIFIER, from being imported to BigQuery properly.
  • Fixed issue preventing the “First row is header?” attribute from displaying properly for File Imports.
  • Fixed issue preventing CASS/NCOA job notifications from saving.
  • Fixed issue preventing the Verify Table Row Counts feature from working properly for Database Syncs from BigQuery to Redshift.
  • Fixed issue preventing IDR job state from updating properly in some scenarios.

Week Ending 10/26/2024

Updates

  • We’re thrilled to announce the launch of the Civis AI suite, integrating Large Language Models and generative AI into the Civis Platform. Key features include: easy access via the “Civis AI” Navigation Menu or API, flexible model options for your needs, automation, and secure data handling, since your data never leaves the Civis Platform environment. Available now, we invite you to explore our free tier and reach out at hello@civisanalytics.com for more credits or to schedule a demo. We can’t wait to hear your feedback! Visit the blog and documentation for potential use cases.
    • Civis AI: Taxonomer streamlines data categorization.
    • Civis AI: Core allows you to create tailored AI prompts.

Bug Fixes

  • The “Export to S/FTP” script template: If an output filename is provided, the script now detects and removes any forward slashes (i.e., the “/” character), which would raise an error in the data export.
  • The “Import from S3” script template: Script run logs no longer show data in error messages.

Help Articles Updated

Week Ending 10/12/2024

Updates

  • Improved the loading time and performance of the “My Profile” page
  • The dbt “retry” command now ignores command line arguments to make the command easier to use.

Bug Fixes

  • Fixed the “Verify Table Row Counts” feature for BigQuery database syncs.

Week Ending 09/21/2024

Updates

  • Made improvements to the Query tool to improve the experience when pasting in large queries.
  • Improved clarity of the manage versions experience when setting up a new Github connection.
  • Added additional info to the GET/database endpoint, including host, port, and database name.

Bug Fixes

  • Fixed broken search links for IDR pipelines.
  • Fixed an issue preventing IDR pipelines from being scheduled via the UI.
  • Fixed an issue preventing container scripts from running when the command was pasted from a Windows machine.
  • Fix for “unrecognized node type: 407” errors occasionally occurring in queries.

Help Articles Updated

Week Ending 09/14/2024

Updates

  • Salesforce Import: The internal logic for handling Salesforce data has been updated, to be more robust for potential issues related to CSV handling (e.g., the comma character being part of the actual data).
  • New container scripts will now use the latest version of datascience-python, currently v8.0, by default.
  • New Python Jupyter notebooks will now use the latest version of the civis-jupyter-python3 Docker image, currently v4.0, by default.
  • The Query tool now includes the option to open your query as a SQL Report in a new “Open As” menu.
  • dbt scripts now have an option to skip dbt docs generation.
  • dbt run outputs will now have job and run IDs appended to their file names.
  • Disk space usage chart in the Platform Usage Overview will now display usage in TB instead of percents.

Help Articles Updated

Week Ending 09/07/2024

Updates

  • The Remote Host Detail and Edit pages have been given a new and updated appearance.

Week Ending 08/31/2024

Bug Fixes

  • Clarified SQL Script errors when the specified git ref doesn’t exist, e.g. a branch was deleted.
  • Fixed Data Crosswalk output for non-existent mappings - they will now be mapped to NULL instead of the string “null”.

Help Articles Updated

Week Ending 08/24/2024

Updates

  • The Table Details page now includes an “Add to Project” button in the top right-hand corner.
  • Added support for dbt retry command.
  • dbt jobs can now be run using pre-release versions of dbt core.

Bug Fixes

  • Fixed a bug preventing some objects from being added to projects.
  • Worflows will now return a more descriptive error message if an execution is started with improper input parameters.
  • Fixed remote host links in Transfer Dependencies side pane.

Week Ending 08/17/2024

Updates

  • Added real-time requirements feedback to the database password reset process.
  • Updated the R docker images to provide new supported versions, see our documentations for details.

Help Articles Updated

Week Ending 08/10/2024

Updates

  • Platform now offers a dbt job type. You can find it under the Code menu in the top nav. To learn more, see our documentation.
  • The default number of query preview rows has been increased from 10 rows to 50 rows.

Bug Fixes

  • Fixed issue preventing language scripts from showing error messages when saving.
  • The “Add to Project” button in the projects side bar has been fixed for Table objects. See our documentation to learn more.

Help Articles Updated

Week Ending 08/03/2024

Updates

  • Google Analytics Import: Updated the maximum allowed number of records returned from a Google Analytics API call from 50,000 to 100,000.
  • The data pane now includes a button to copy the qualified table name to your clipboard.
  • Fixed parameter values are now shown on Template backing Scripts.
  • Added a description attribute to the Files API.
  • Geocoder has been updated to include the latest Canadian addresses.  

Bug Fixes

  • Salesforce Export: Fixed the row count for failed records in the logs.

Week Ending 07/20/2024

Updates

  • New Python Jupyter notebooks will now use the latest version of the civis-jupyter-python3 Docker image, currently v3.1, by default. This latest version is on Python 3.12.
  • Added Tableau Single Sign-On (SSO) which simplifies access to Tableau Server and Desktop with centralized authentication using platform credentials, enhancing security and streamlining user experience. Get started with setup instructions here.

Week Ending 07/13/2024

Bug Fixes

  • Fixed a bug causing first row to be duplicated in BigQuery Exports to Google Sheets.

Week Ending 06/29/2024

Updates

  • The Database Usage page now includes a Query Duration by Phase graph indicating the average amount of time which queries spend in each phase at a given time. Go to Admin -> Platform Usage Overview -> Database -> Query Performance to view the new graph.
  • Added the ability for users to order their favorites on the home page by preference, instead of by when the favorite was added. Using the icons on the right of the table, users can move items up or down or send them to the top or bottom of the list.

Week Ending 06/22/2024

Updates

  • New container scripts will now use the latest version of the Civis datascience-python docker image, currently v7.3.0, by default.

Week Ending 06/08/2024

Updates

  • New quick-start Service Templates are available to help you launch your own dashboards, APIs, and other applications in Civis. We offer example apps for a few different frameworks: Streamlit, Shiny, and Flask under the “Publish” menu. For more information, see our Services Documentation.

Bug Fixes

  • Fixed “Add to Project” button in projects left side pane for Template Scripts.
  • Fixed issue where long Script Parameter names could overflow their column in the Parameters table.

Week Ending 06/01/2024

Updates

  • Updated CASS/NCOA to use a new version of the vendor API for improved stability and support.
  • IDR Pipelines will now error before running if an enforced link column no longer exists.

Bug Fixes

  • Fixed a bug preventing IDR errors from displaying properly.

Week Ending 05/25/2024

Updates

  • JavaScript Scripts have been updated to use V8 engine version 10.2.154.26, allowing access to new JavaScript language features, including but not limited to nicer syntax for classes and improved support for string interpolation and multi-line strings via back-tick strings. See here for a list of popular V8 syntax features: https://developers.google.com/apps-script/guides/v8-runtime#v8-syntax

Week Ending 05/18/2024

Updates

  • Civis API Python client v2.0.0 has been released. For details, please see the release notes. The documentation has also been updated. If you’re using Python 3.9 or later, it is available through “pip install civis==2.0.0” or equivalent. Highlights for this release:
    • To facilitate development work, the details of the API endpoints and methods are now available to a “civis.APIClient” instance in your local IDE (e.g., VS Code, PyCharm) for auto code suggestions, type checking, etc.
    • In the documentation, the API resources each have their own page for easier navigation.
    • For Civis Platform scripts, a new function “civis.civis_logger()” is available as a drop-in replacement for Python’s built-in “logging.getLogger(__name__)”. This logger has been configured to send INFO-level (or below) logging to stdout so that the log messages show up in black on Civis Platform, and WARNING-level (or above) logging to stderr in red.
    • A “CivisFuture” instance now has a new property “job_url”.

Bug Fixes

  • Fixed issue causing the workflows detail page to crash when loading a custom task with a parameterized credential.
  • Fixed support for database syncs with a source redshift cluster outside of us-east-1.

Week Ending 05/11/2024

Updates

  • No Updates

Bug Fixes

  • Fixed bug where database syncs from Postgres to BigQuery would convert NULLs to FALSE.
  • Fixed bug causing Query tool to display BigQuery boolean values incorrectly.
  • IDR Pipelines can now be added to Projects directly from the Projects side pane.

Week Ending 05/04/2024

Updates

  • Projects detail page now shows breadcrumb navigation for parent projects.

Bug Fixes

  • Snowflake NUMBER columns with decimal digits precision of 0 will now be mapped to the INTEGER data type in db syncs to BigQuery databases. NUMBER columns with decimal digits precision > 0 will continue to be mapped to the FLOAT64 data type.
  • Fixed display of BigQuery boolean values in Query tool results.
  • Fixed duplicate error banners in data side pane.
  • Fixed success banners for the “Add to Workflow” standard action.

Week Ending 04/27/2024

Updates

  • Added ‘Description’ field to Reports.
  • Extended support for DB Syncs to Redshift clusters in all regions
  • Added SQL Reports: a new reporting capability that allows you to quickly create visualizations using SQL statements and then customize your visualizations directly in Platform. For more information, see our documentation or click here to try it out!

Week Ending 04/13/2024

Updates

  • Improved performance of the Remote Hosts API and index page.
    Top nav bar searches may now be sorted by Updated At date.

Bug Fixes

  • Fixed bug preventing projects bar search results from showing in the correct order.
     

Week Ending 03/16/2024

Updates

  • IDR pipelines can now be cancelled from the UI.

Week Ending 03/09/2024

Updates

  • MySQL Database Syncs no longer require local file loads and are now compatible with MySQL 8 databases using default settings. local_infile may be set to either true or false.
  • IDR will now give you a warning if you are about to navigate away with unsaved changes.

Week Ending 02/11/2024

Updates

  • Added Data Crosswalk, which is a new feature that will allow users to streamline the process of categorizing data values. For more information about this feature attend the webinar next week or visit this blog post. 

Bug Fixes

  • Fixed issue preventing the “Verify Table Row Count” feature from working with BigQuery database syncs.

Week Ending 01/20/2024

Bug Fixes

  • When navigating to the Scripts, Imports, and Exports index pages, users will no longer receive the “Failed to load Scripts” error message. The pages will load correctly.

Week Ending 01/13/2024

Updates

  • New Import from Phone2Action - Advocates has been released. Please reference this documentation for more information.

Help Article Updates

Related articles

Comments

0 comments

Article is closed for comments.