0.35.6

Release Notes - ED - Version 17511

Bug fixes

• Fix an issue whereby if users create multiple storage instances in different projects with the same name they would overwrite one another.

• Fix an issue whereby users are not able to turn on private notebooks.

• Fix an issue whereby new users were re-directed to a 404 page after verifying their e-mail address.

New features

• Enable use of Streamlit as a publishing option within DataLabs.

• Users can now create Streamlit sites using a script in a data store and a configured Conda environment.

• The "Edit Storage" dialog box only shows users currently in the project in the autocomplete dropdown, instead of all known users in DataLabs.

• Add a tutorial on how to publish a Streamlit site within DataLabs.

• Enable the default working directory to be the base notebook directory

• Individual warning messages can now be closed. A 'X' close button appears on the message to allow it to be closed. When the page is refreshed the warning message returns, so is not persistent.

• Allow users to hide e-mail information on the notebooks and sites pages for privacy reasons while screen sharing or e.g recording demos.

• When adding new users to a project on the Project > Settings page, the autocomplete of the Add User dropdown will not contain anything until the input text exactly matches a user name known to the system. This ensures that the full list of e-mails (which are used for user names) cannot be easily viewed and explored in that dropdown. However, it is useful to know when you have an exact match to one known in the system, to help avoid adding a new user name that contains a typo. It is still possible to add new users that don't yet exist in the system.

• User email addresses are hidden behind a dropdown toggle on the project information page.

• Add documentation tutorial on how to publish a Shiny site within DataLabs.

• Upgrade all DataLabs components to use the Node version 20.

0.35.3

What's Changed

• fix: fix bug where creation of project is not in the project context by @iwalmsley in #965
• ED-104 Fix 404 after sign up for new users by @iwalmsley in #967
• Ed 103 Fix users not able to scale private notebooks by @o2a in #969
• Avoid showing contributor email addresses on project info page by @jshholland in #970
• Add missing "1" key back to development-env's storage_config.json by @jshholland in #972

Full Changelog: 0.35.2...0.35.3

0.35.2

Merge pull request #962 from NERC-CEH/ED-87-streamlit-frontend

ED-87 Add Streamlit Frontend

0.35.1

Merge pull request #964 from NERC-CEH/build-on-tag

fix: correct action used

0.35.0

What's Changed

• Asset Repo documentation by @iwalmsley in #873
• chore(deps): bump postcss from 7.0.17 to 7.0.36 in /code by @dependabot in #856
• chore(deps): bump node-fetch from 2.6.1 to 2.6.7 in /code by @dependabot in #859
• chore(deps): bump undefsafe from 2.0.2 to 2.0.5 in /code by @dependabot in #861
• chore(deps): bump follow-redirects from 1.14.7 to 1.14.8 in /code by @dependabot in #862
• chore(deps): bump url-parse from 1.5.3 to 1.5.10 in /code by @dependabot in #864
• chore(deps): bump minimist from 1.2.5 to 1.2.6 in /docs by @dependabot in #867
• chore: bumping package versions by @iwalmsley in #878
• chore(deps): bump nanoid from 3.1.30 to 3.3.3 in /code by @dependabot in #870
• chore(deps): bump jpeg-js from 0.4.2 to 0.4.4 in /code by @dependabot in #876
• chore(deps): bump eventsource from 1.0.7 to 1.1.2 in /code by @dependabot in #877
• chore(deps): bump moment from 2.29.2 to 2.29.4 in /code by @dependabot in #879
• updates to test script from phase 4 by @fergus-ella-capeng in #847
• NERCDL-1195: Suspend Unused Notebooks by @iwalmsley in #883
• feat: update deployment template to link to assets by @iwalmsley in #886
• feat: enable users to manually scale their stacks (not just admins) by @iwalmsley in #887
• NERCDL-1145 MUI 5 by @iwalmsley in #860
• fix: updates for mui/x-date-picker by @iwalmsley in #889
• chore: fix lint warnings by @iwalmsley in #891
• chore(deps): bump minimatch from 3.0.4 to 3.0.8 in /docs by @dependabot in #890
• chore(deps): bump terser from 4.2.1 to 4.8.1 in /code by @dependabot in #880
• chore(deps): bump jose from 2.0.5 to 2.0.6 in /code by @dependabot in #885
• chore(deps): bump apollo-server-core from 3.6.2 to 3.11.0 in /code by @dependabot in #888
• chore(deps): bump decode-uri-component from 0.2.0 to 0.2.2 in /code by @dependabot in #892
• chore(deps): bump express from 4.17.1 to 4.17.3 in /code by @dependabot in #894
• chore(deps): bump qs from 6.5.2 to 6.5.3 in /code by @dependabot in #893
• Correcting env-control remove command in docs by @samharrison7 in #901
• fix: bump Voila run parameters for > 0.3 by @iwalmsley in #902
• chore(deps): bump json5 from 1.0.1 to 1.0.2 in /code by @dependabot in #896
• Update dev docs by @iwalmsley in #906
• chore(deps): bump convict from 6.2.3 to 6.2.4 in /code by @dependabot in #897
• chore(deps): bump http-cache-semantics from 4.1.0 to 4.1.1 in /code by @dependabot in #900
• chore(deps): bump semver from 5.7.1 to 5.7.2 in /code by @dependabot in #903
• chore(deps): bump word-wrap from 1.2.3 to 1.2.4 in /code by @dependabot in #905
• fix: ensure all references to k8s upgrade are complete by @iwalmsley in #907
• update documentation by @iwalmsley in #914
• docs: update documentation errant command by @iwalmsley in #915
• Update docs by @iwalmsley in #916
• feat: remove dev default userroles due to change in default behavior by @iwalmsley in #917
• docs: change from service external name to endpoint for IP address re… by @iwalmsley in #918
• NERCDL-1205 Allow project members to un-suspend shared notebooks by @iwalmsley in #908
• Update documentation about suspending notebooks by @jshholland in #919
• changing web app settings to use custom domain by @o2a in #925
• auth: redirect to signup page when clicking on sign up links by @jshholland in #926
• chore: update docs with new login images by @o2a in #927
• Feature/ed 46 api vscode by @joncooper65 in #928
• fix: correct liveness probe and init container dir setup by @iwalmsley in #929
• fix: don't create asset folder - put in image instead by @iwalmsley in #930
• ED-64 VSCode Permissions by @iwalmsley in #931
• ED-54 Update Asset Model by @iwalmsley in #932
• ED-55 eidc asset styling by @joncooper65 in #934
• ED-62 edit assets dynamically by @iwalmsley in #935
• VS Code docs by @jshholland in #933
• chore(deps): bump follow-redirects from 1.15.3 to 1.15.4 in /code by @dependabot in #936
• chore(deps): bump jsonwebtoken from 8.1.1 to 9.0.0 in /code/workspaces/client-api by @dependabot in #921
• chore(deps): bump ip from 1.1.8 to 1.1.9 in /code by @dependabot in #938
• chore(deps): bump nodemailer from 6.9.7 to 6.9.9 in /code by @dependabot in #941
• chore(deps): bump es5-ext from 0.10.62 to 0.10.63 in /code by @dependabot in #944
• chore(deps): bump axios from 0.22.0 to 0.28.0 in /code by @dependabot in #937
• chore(deps): bump axios from 0.22.0 to 0.28.0 in /code/workspaces/web-app by @dependabot in #940
• chore(deps): bump axios from 0.22.0 to 0.28.0 in /code/workspaces/infrastructure-api by @dependabot in #942
• chore(deps): bump axios from 0.25.0 to 0.28.0 in /code/workspaces/client-api by @dependabot in #943
• chore(deps): bump jsonwebtoken from 8.1.1 to 9.0.0 in /code by @dependabot in #895
• feat: changes to email notification settings by @iwalmsley in #945
• fix: minor changes based on testing in staging by @iwalmsley in #946
• Warn user that RStudio notebook may be in use by @joncooper65 in #948
• deps: Update dependencies which depend on vulnerable lodash.set by @jshholland in #950
• chore(deps): bump follow-redirects from 1.15.5 to 1.15.6 in /code by @dependabot in #952
• chore(deps): bump jose from 2.0.6 to 2.0.7 in /code by @dependabot in #951
• chore(deps): bump express from 4.17.3 to 4.19.2 in /code/workspaces/infrastructure-api by @dependabot in #953
• chore(deps): bump express from 4.17.3 to 4.19.2 in /code/workspaces/client-api by @dependabot in #954
• chore(deps): bump express from 4.17.3 to 4.19.2 in /code by @dependabot in #955
• Notify the user more forcefully when a project is requested by @jshholland in #947
• docs: add documentation to add rwx provisioner in dev environment by @iwalmsley in #957
• Corrected link to 'how-to' docs for rstudio notebook warning message by @joncooper65 in #956
• Added RStudio how-to page to content page of Docs by @joncooper65 in #958
• Rstudio notebook warning and Requested state by @joncooper65 in #959
• ED-68 Enable pre-creation of users by @iwalmsley in #949
• Add streamlit backend by @jshholland in #961

New Contributors

• @fergus-ella-capeng made their first contribution in #847
• @samharrison7 made their first contribution in #901
• @jshholland made their first contribution in #919
• @joncooper65 made their first contribution in #928

Full Changelog: 0.34.0...0.35.0

0.34.0

What's Changed

• NERCDL-1058: Panel and Voila by @david-worley-tessella in #799
• NERCDL-1079: Collaboration documentation fix by @david-worley-tessella in #798
• NERCDL-1058: Panel deployment environment variable by @david-worley-tessella in #800
• Feature/dev deps upgrade by @ray-millward-tessella in #803
• NERCDL-1058: Fixed Panel url by @david-worley-tessella in #801
• refactor: fixed linting warnings as this was blocking the full build by @ray-millward-tessella in #804
• NERCDL-1058: Panel and Voila user tutorials by @david-worley-tessella in #802
• NERCDL-1135: Add assets to notebook by @david-worley-tessella in #806
• Feature/nercdl 1140 email from datalab by @ray-millward-tessella in #805
• Feature/nercdl 702 request project by @ray-millward-tessella in #807
• NERCDL-1135: Added new asset action by @david-worley-tessella in #808
• NERCDL-1136: Link to add asset form by @david-worley-tessella in #809
• feat: updated to node 16.13.0 across the code base by @ray-millward-tessella in #811
• NERCDL-1136: Fixed add asset form issues by @david-worley-tessella in #812
• feat: put the request project button behind a feature flag by @ray-millward-tessella in #813
• feat: updated and re-ran the lighthouse tests by @ray-millward-tessella in #810
• NERCDL-1138: Fixed message buttons styling by @david-worley-tessella in #815
• Nercdl 1142 fix asset mounting by @ray-millward-tessella in #816
• feat: updated the babel dependencies to remove audit security issues by @ray-millward-tessella in #817
• NERCDL-914: Get Assets for User (backend) by @david-worley-tessella in #818
• feat: added missing runtime dependencies that were failing in the doc… by @ray-millward-tessella in #820
• feat: added in the missing runtime dependency for babel by @ray-millward-tessella in #821
• NERCDL-914: Get Assets for User (frontend) by @david-worley-tessella in #822
• Nercdl 1142 fix asset mounting by @ray-millward-tessella in #824
• NERCDL-1008: Get projects for user by @david-worley-tessella in #825
• feat: fixed apollo client start up so it works properly by @ray-millward-tessella in #826
• NERCDL-1008: Asset edit permissions by @david-worley-tessella in #827
• NERCDL-1008: Updated Insomnia collection by @david-worley-tessella in #828
• feat: updated the remaining frontend vulnerabilities in the system by @ray-millward-tessella in #829
• feat: updated the my projects filter to use a switch instead by @ray-millward-tessella in #830
• feat: added in a mongo status check to cause the system to restart by @ray-millward-tessella in #832
• NERCDL-515: Private stacks backend by @david-worley-tessella in #831
• NERCDL-515: Private stacks frontend by @david-worley-tessella in #833
• Nercdl 1145 mui 5 upgrade by @ray-millward-tessella in #834
• NERCDL-515: Fix make Jupyter private by @david-worley-tessella in #835
• Nercdl 1145 mui 5 upgrade by @ray-millward-tessella in #836
• NERCDL-515: SecurityContext fix and add tooltips by @david-worley-tessella in #837
• Nercdl 1145 mui 5 upgrade by @ray-millward-tessella in #838
• NERCDL-515: Timestamp in Job names by @david-worley-tessella in #839
• NERCDL-1145: React testing library in pages folder by @david-worley-tessella in #840
• Nercdl 1145 mui 5 upgrade by @ray-millward-tessella in #841
• refactor: migrated last of the test-utils usages by @ray-millward-tessella in #842
• NERCDL-1145: Webapp test files update by @david-worley-tessella in #843
• NERCDL-1145: Admin Resources tests by @david-worley-tessella in #844
• Nercdl 1145 mui 5 upgrade by @ray-millward-tessella in #845
• NERCDL-1145: Admin list users tests by @david-worley-tessella in #846
• NERCDL-1145: App Navigation tests by @david-worley-tessella in #848
• Nercdl 1145 mui 5 upgrade by @ray-millward-tessella in #849
• NERCDL-1145: Updated more webapp tests by @david-worley-tessella in #850
• chore(deps): bump path-parse from 1.0.6 to 1.0.7 in /code by @dependabot in #752
• chore(deps): bump path-parse from 1.0.6 to 1.0.7 in /docs by @dependabot in #753
• chore(deps): bump tar from 4.4.10 to 4.4.19 in /code by @dependabot in #754
• chore(deps): bump tmpl from 1.0.4 to 1.0.5 in /code by @dependabot in #766
• Bump url-parse from 1.5.1 to 1.5.3 in /code by @dependabot in #780
• chore(deps): bump follow-redirects from 1.14.1 to 1.14.7 in /code by @dependabot in #853
• chore(deps): bump ws from 5.2.2 to 5.2.3 in /code by @dependabot in #814
• chore(deps): bump dot-prop from 4.2.0 to 4.2.1 in /code by @dependabot in #819
• chore(deps): bump shelljs from 0.8.3 to 0.8.5 in /docs by @dependabot in #854
• chore(deps): bump shelljs from 0.8.3 to 0.8.5 in /code by @dependabot in #855
• Axios patch by @iwalmsley in #858
• Correct runcmd for Jupyter Notebooks by @iwalmsley in #852
• chore(deps): bump minimist from 1.2.5 to 1.2.6 in /code by @dependabot in #865
• chore(deps): bump moment from 2.21.0 to 2.29.2 in /code by @dependabot in #866
• chore(deps): bump ajv from 6.10.2 to 6.12.6 in /code by @dependabot in #871
• chore(deps): bump convict from 6.2.1 to 6.2.2 in /code by @dependabot in #868
• feat: revert changes for jupyter base dir by @iwalmsley in #869

Full Changelog: 0.33.0...0.34.0

0.33.0

What's Changed

• NERCDL-1049 single host minio by @andrew-longmore-tessella in #741
• NERC-457 remove unused datalab collection and code by @andrew-longmore-tessella in #733
• Updated STS by @RajdeepUppal in #740
• NERCDL-1050 move jupyter and jupyterlab to single host by @andrew-longmore-tessella in #742
• NERCDL-1052 single host for rstudio by @andrew-longmore-tessella in #743
• NERCDL-1052: fix liveness probe to avoid redirect by @andrew-longmore-tessella in #744
• NERCDL-1052 switch proxy info from file to http header by @andrew-longmore-tessella in #746
• Deployment test script by @RajdeepUppal in #747
• chore(deps): bump tree-kill from 1.2.1 to 1.2.2 in /code by @dependabot in #571
• chore(deps): bump http-proxy from 1.17.0 to 1.18.1 in /code by @dependabot in #572
• chore(deps): bump ini from 1.3.5 to 1.3.7 in /docs by @dependabot in #644
• chore(deps): bump ini from 1.3.5 to 1.3.7 in /code by @dependabot in #645
• chore(deps): bump axios from 0.19.0 to 0.21.1 in /code by @dependabot in #651
• chore(deps): bump elliptic from 6.5.3 to 6.5.4 in /code by @dependabot in #698
• chore(deps): bump y18n from 3.2.1 to 3.2.2 in /code by @dependabot in #711
• chore(deps): bump underscore from 1.9.1 to 1.13.1 in /code by @dependabot in #734
• chore(deps): bump ssri from 6.0.1 to 6.0.2 in /code by @dependabot in #732
• chore(deps): bump handlebars from 4.5.3 to 4.7.7 in /code by @dependabot in #735
• chore(deps): bump url-parse from 1.4.7 to 1.5.1 in /code by @dependabot in #736
• chore(deps): bump bson from 1.1.1 to 1.1.6 in /code by @dependabot in #737
• chore(deps): bump lodash from 4.17.19 to 4.17.21 in /code by @dependabot in #738
• chore(deps): bump hosted-git-info from 2.8.4 to 2.8.9 in /code by @dependabot in #739
• chore(deps): bump dns-packet from 1.3.1 to 1.3.4 in /code by @dependabot in #748
• chore(deps): bump merge-deep from 3.0.2 to 3.0.3 in /code by @dependabot in #749
• fix: only display topbar url if configured by @iwalmsley in #750
• Setup and config updates by @david-worley-tessella in #755
• NERCDL-981: Anonymise data and convert user IDs by @david-worley-tessella in #756
• NERCDL-981: Data storage deletion message by @david-worley-tessella in #757
• NERCDL-981 Retrieve clusters using data stores by @david-worley-tessella in #758
• Feature/nercdl 984 cluster assets UI by @ray-millward-tessella in #759
• SSH and release instructions update by @david-worley-tessella in #760
• NERCDL-1093: Spark config maps by @david-worley-tessella in #762
• NERCDL-1092: Added SPARK type by @david-worley-tessella in #761
• Dask docker version update to 2021.6.2 by @david-worley-tessella in #763
• Feature/nercdl 1015 mount assets in cluster by @ray-millward-tessella in #764
• NERCDL-1094: Per Project Spark Kubernetes Templates by @david-worley-tessella in #765
• NERCDL-1095: Spark cluster creation by @david-worley-tessella in #767
• NERCDL-1096: Spark UI by @david-worley-tessella in #768
• NERCDL-1094: Spark k8s updates by @david-worley-tessella in #769
• NERCDL-1128: Spark R snippets by @david-worley-tessella in #770
• NERCDL-1100: Spark cluster user tutorial by @david-worley-tessella in #771
• NERCDL-1120: Messages in infrastructure API by @david-worley-tessella in #772
• Feature/nercdl 1102 suspende state by @ray-millward-tessella in #774
• NERCDL-1120: Messages in client api by @david-worley-tessella in #773
• Feature/nercdl 1102 suspende state by @ray-millward-tessella in #775
• Feature/nercdl 1102 suspende state by @ray-millward-tessella in #776
• NERCDL-1121: Messages in webapp by @david-worley-tessella in #777
• NERCDL-1121: Markdown in messages by @david-worley-tessella in #778
• Feature/nercdl 1102 suspende state by @ray-millward-tessella in #779
• NERCDL-1126: Cluster scaling infrastructure API by @david-worley-tessella in #781
• feat: updated admin resources to show actions list for stacks by @ray-millward-tessella in #782
• NERCDL-1126: Cluster scaling API and web app by @david-worley-tessella in #783
• Feature/nercdl 1102 suspende state by @ray-millward-tessella in #784
• NERCDL-1126: Fixed cluster scaling confirmation message by @david-worley-tessella in #785
• feat: attempting an optional github step for auditing vulnerabilities by @ray-millward-tessella in #786
• NERCDL-1126: Cluster admin permissions by @david-worley-tessella in #787
• NERCDL-1124: Admin messages list and delete by @david-worley-tessella in #789
• Feature/nercdl 1088 yarn audit by @ray-millward-tessella in #790
• NERCDL-1125: Message Creation by @david-worley-tessella in #791
• Feature/nercdl 579 viewer stacks by @ray-millward-tessella in #792
• NERCDL-1110: Cert Manager annotation by @david-worley-tessella in #794
• NERCDL-1079: Collaborative jupyterlab by @david-worley-tessella in #795
• NERCDL-1125: Set minimum message expiry date by @david-worley-tessella in #796
• NERCDL-1118: First login tutorial by @iwalmsley in #793
• NERCDL-1129 Project limitation by @iwalmsley in #797

New Contributors

• @david-worley-tessella made their first contribution in #755

Full Changelog: 0.32.5...0.33.0

0.24.0

Merge pull request #366 from NERC-CEH/fix-auth-svc-build

Fix Auth Service Build