What’s new

2021

2021/09/12

  • Jetson units are upgraded to JetPack 4.6 (L4T 32.6.1)

  • New Packages

    • ase: 3.22.0

    • astor: 0.8.1

    • autopage: 0.4.0

    • cytoolz: 0.11.0

    • jupyterlab-language-pack-ca-ES: 3.1.post0

    • jupyterlab-language-pack-cs-CZ: 3.1.post0

    • jupyterlab-language-pack-da-DK: 3.1.post0

    • jupyterlab-language-pack-de-DE: 3.1.post0

    • jupyterlab-language-pack-el-GR: 3.1.post0

    • jupyterlab-language-pack-es-ES: 3.1.post0

    • jupyterlab-language-pack-et-EE: 3.1.post0

    • jupyterlab-language-pack-fi-FI: 3.1.post0

    • jupyterlab-language-pack-fr-FR: 3.1.post0

    • jupyterlab-language-pack-he-IL: 3.1.post0

    • jupyterlab-language-pack-hu-HU: 3.1.post0

    • jupyterlab-language-pack-hy-AM: 3.1.post0

    • jupyterlab-language-pack-id-ID: 3.1.post0

    • jupyterlab-language-pack-it-IT: 3.1.post0

    • jupyterlab-language-pack-ja-JP: 3.1.post0

    • jupyterlab-language-pack-ko-KR: 3.1.post0

    • jupyterlab-language-pack-lt-LT: 3.1.post0

    • jupyterlab-language-pack-nl-NL: 3.1.post0

    • jupyterlab-language-pack-no-NO: 3.1.post0

    • jupyterlab-language-pack-pl-PL: 3.1.post0

    • jupyterlab-language-pack-pt-BR: 3.1.post0

    • jupyterlab-language-pack-ro-RO: 3.1.post0

    • jupyterlab-language-pack-ru-RU: 3.1.post0

    • jupyterlab-language-pack-tr-TR: 3.1.post0

    • jupyterlab-language-pack-uk-UA: 3.1.post0

    • jupyterlab-language-pack-vi-VN: 3.1.post0

    • jupyterlab-language-pack-zh-CN: 3.1.post0

    • jupyterlab-language-pack-zh-TW: 3.1.post0

    • jupyterlab-spreadsheet-editor: 0.6.0

    • keepalive: 0.5

    • onnx-tf: 1.9.0

    • SPARQLWrapper: 1.8.5

    • tensorboardX: 2.4

    • tf2onnx: 1.9.2

  • Downgraded Packages

    • laspy: 2.0.2 -> 1.7.1

  • Upgraded Packages

    • aiobotocore: 1.4.0 -> 1.4.1

    • anyio: 3.3.0 -> 3.3.1

    • argon2-cffi: 20.1.0 -> 21.1.0

    • astroid: 2.7.2 -> 2.7.3

    • beautifulsoup4: 4.9.3 -> 4.10.0

    • black: 21.7b0 -> 21.8b0

    • bleach: 4.0.0 -> 4.1.0

    • cliff: 3.8.0 -> 3.9.0

    • cloudpickle: 1.6.0 -> 2.0.0

    • colorlog: 5.0.1 -> 6.4.1

    • comet-ml: 3.14.1 -> 3.15.4

    • cryptography: 3.4.7 -> 3.4.8

    • cupy: 9.3.0 -> 9.4.0

    • dask: 2021.8.1 -> 2021.9.0

    • debugpy: 1.4.1 -> 1.4.3

    • decorator: 5.0.9 -> 5.1.0

    • distributed: 2021.8.1 -> 2021.9.0

    • docker: 5.0.0 -> 5.0.2

    • dulwich: 0.20.24 -> 0.20.25

    • earthengine-api: 0.1.279 -> 0.1.282

    • eodag-sentinelsat: 0.4.0 -> 0.4.1

    • everett: 2.0.0 -> 2.0.1

    • fsspec: 2021.7.0 -> 2021.8.1

    • gcsfs: 2021.7.0 -> 2021.8.1

    • geemap: 0.8.18 -> 0.9.0

    • geetools: 0.6.11 -> 0.6.14

    • GeoAlchemy2: 0.9.3 -> 0.9.4

    • glue-core: 1.2.0 -> 1.2.1

    • google-auth-oauthlib: 0.4.5 -> 0.4.6

    • google-cloud-storage: 1.42.0 -> 1.42.1

    • imageio-ffmpeg: 0.4.4 -> 0.4.5

    • importlib-metadata: 4.6.4 -> 4.8.1

    • ipydatagrid: 1.1.3 -> 1.1.5

    • ipyfilechooser: 0.4.4 -> 0.5.0

    • ipykernel: 6.2.0 -> 6.4.1

    • ipython: 7.26.0 -> 7.27.0

    • ipywidgets: 7.6.3 -> 7.6.4

    • jupyter-archive: 3.0.1 -> 3.0.3

    • jupyter-server: 1.10.2 -> 1.11.0

    • jupyterlab: 3.1.9 -> 3.1.11

    • jupyterlab-server: 2.7.2 -> 2.8.1

    • jupyterlab-spellchecker: 0.7.0 -> 0.7.1

    • jupyterlab-widgets: 1.0.0 -> 1.0.1

    • jupytext: 1.11.4 -> 1.12.0

    • keyring: 23.1.0 -> 23.2.0

    • kiwisolver: 1.3.1 -> 1.3.2

    • lark-parser: 0.11.3 -> 0.12.0

    • leafmap: 0.4.1 -> 0.4.2

    • matplotlib-inline: 0.1.2 -> 0.1.3

    • mlflow: 1.19.0 -> 1.20.2

    • msal: 1.13.0 -> 1.14.0

    • nbgitpuller: 0.10.2 -> 1.0.2

    • networkx: 2.6.2 -> 2.6.3

    • numcodecs: 0.9.0 -> 0.9.1

    • onnxmltools: 1.9.0 -> 1.9.1

    • openpyxl: 3.0.7 -> 3.0.8

    • orange-canvas-core: 0.1.21 -> 0.1.22

    • OWSLib: 0.24.1 -> 0.25.0

    • Pillow: 8.3.1 -> 8.3.2

    • planetary-computer: 0.3.0 -> 0.4.1

    • platformdirs: 2.2.0 -> 2.3.0

    • pluggy: 0.13.1 -> 1.0.0

    • pooch: 1.4.0 -> 1.5.1

    • prettytable: 2.1.0 -> 2.2.0

    • pygeos: 0.10.1 -> 0.10.2

    • pytest: 6.2.4 -> 6.2.5

    • python-box: 5.4.0 -> 5.4.1

    • qasync: 0.18.1 -> 0.21.0

    • QtPy: 1.10.0 -> 1.11.0

    • quilt3: 3.4.0 -> 3.5.0

    • rasterio: 1.2.6 -> 1.2.8

    • regex: 2021.8.21 -> 2021.8.28

    • ruamel.yaml: 0.17.14 -> 0.17.16

    • s3fs: 2021.8.0 -> 2021.8.1

    • scikit-image: 0.18.2 -> 0.18.3

    • setuptools: 57.4.0 -> 57.5.0

    • setuptools-scm: 6.0.1 -> 6.3.2

    • simplejson: 3.17.4 -> 3.17.5

    • smart-open: 5.2.0 -> 5.2.1

    • spacy-transformers: 1.0.4 -> 1.0.6

    • sparse: 0.12.0 -> 0.13.0

    • sqlparse: 0.4.1 -> 0.4.2

    • terminado: 0.11.1 -> 0.12.1

    • thinc: 8.0.8 -> 8.0.10

    • tifffile: 2021.8.8 -> 2021.8.30

    • torch-sparse: 0.6.11 -> 0.6.12

    • tqdm: 4.62.1 -> 4.62.2

    • traitlets: 5.0.5 -> 5.1.0

    • typing-extensions: 3.7.4.3 -> 3.10.0.2

    • voila: 0.2.10 -> 0.2.12

    • whitebox: 1.5.2 -> 2.0.3

    • whiteboxgui: 0.3.0 -> 0.5.0

    • wurlitzer: 3.0.0 -> 3.0.2

    • xarray-spatial: 0.2.7 -> 0.2.9

    • xyzservices: 2021.8.1 -> 2021.9.0

    • zarr: 2.8.3 -> 2.9.5

2021/08/22

  • CUDA support of PoCL is disabled on Jetson units due to compatibility issues

  • New Packages

    • platformdirs: 2.2.0

  • Removed Packages

    • fire: 0.4.0

    • keras2onnx: 1.7.0

  • Upgraded Packages

    • aiobotocore: 1.3.3 -> 1.4.0

    • astroid: 2.6.6 -> 2.7.2

    • catalogue: 2.0.5 -> 2.0.6

    • dask: 2021.8.0 -> 2021.8.1

    • distributed: 2021.8.0 -> 2021.8.1

    • earthengine-api: 0.1.278 -> 0.1.279

    • llvmlite: 0.37.0rc2 -> 0.37.0

    • Mako: 1.1.4 -> 1.1.5

    • morecantile: 2.1.2 -> 2.1.4

    • numba: 0.54.0rc3 -> 0.54.0

    • numcodecs: 0.8.1 -> 0.9.0

    • onnxconverter-common: 1.7.0 -> 1.8.1

    • onnxmltools: 1.7.0 -> 1.9.0

    • prompt-toolkit: 3.0.19 -> 3.0.20

    • pylint: 2.9.6 -> 2.10.2

    • pyresample: 1.20.0 -> 1.21.0

    • regex: 2021.8.3 -> 2021.8.21

    • ruamel.yaml: 0.17.11 -> 0.17.13

    • s3fs: 2021.7.0 -> 2021.8.0

    • simplejson: 3.17.3 -> 3.17.4

    • spacy: 3.1.1 -> 3.1.2

    • SQLAlchemy: 1.4.22 -> 1.4.23

    • stevedore: 3.3.0 -> 3.4.0

    • trimesh: 3.9.28 -> 3.9.29

    • wurlitzer: 2.1.1 -> 3.0.0

2021/08/01

Regular platform update

  • Upgraded Languages

    • Python: 3.8.5 -> 3.8.10

    • Go: 1.16.3 -> 1.16.6

    • Scala: 2.12.12 -> 2.12.14

    • Octave: 6.2.0 -> 6.3.0

  • Upgraded Services

    • GeoServer: 2.18.2 -> 2.19.2

    • Gitea: 1.13.1 -> 1.14.5

    • Grafana: 7.3.6 -> 8.0.6

    • PostgreSQL: 12.6 -> 12.7

    • Prometheus: 2.24.0 -> 2.28.1

    • pgAdmin: 5.2 -> 5.5

  • New Packages

    • autobahn: 21.3.1

    • Automat: 20.2.0

    • charset-normalizer: 2.0.4

    • chex: 0.0.8

    • constantly: 15.1.0

    • distro: 1.6.0

    • fastscape: 0.1.0b0

    • fastscapelib-fortran: 2.8.2

    • hsluv: 5.0.2

    • hyperlink: 21.0.0

    • incremental: 21.3.0

    • ipyfastscape: 0.2.0

    • ipygany: 0.5.0

    • ipyurl: 0.1.2

    • jupytext: 1.11.4

    • markdown-it-py: 1.1.0

    • mdit-py-plugins: 0.2.8

    • optax: 0.0.9

    • pycairo: 1.20.1

    • scikit-build: 0.11.1

    • Twisted: 21.7.0

    • txaio: 21.2.1

    • vtk: 9.0.3

    • wslink: 0.2.0

    • xarray-simlab: 0.5.0

    • xyzservices: 2021.7.2

    • zope.interface: 5.4.0

  • Removed Packages

    • tensorboard-data-server: 0.6.1

  • Downgraded Packages

    • plotly: 5.1.0 -> 4.14.3

    • tensorboard: 2.5.0 -> 2.4.1

  • Upgraded Packages

    • aiobotocore: 1.3.1 -> 1.3.3

    • albumentations: 1.0.0 -> 1.0.3

    • anyio: 3.2.1 -> 3.3.0

    • arcgis: 1.8.5.post3 -> 1.9.0

    • astroid: 2.6.1 -> 2.6.6

    • astropy: 4.2.1 -> 4.3.post1

    • bleach: 3.3.0 -> 4.0.0

    • bokeh: 2.3.2 -> 2.3.3

    • boto3: 1.17.49 -> 1.17.106

    • botocore: 1.20.49 -> 1.20.106

    • bqplot: 0.12.29 -> 0.12.30

    • cf-units: 2.1.5 -> 3.0.1.post0

    • cffi: 1.14.5 -> 1.14.6

    • cftime: 1.2.1 -> 1.5.0

    • clustering-geodata-cubes: 0.3.0 -> 0.4.0

    • cmd2: 2.1.1 -> 2.1.2

    • comet-ml: 3.12.2 -> 3.13.2

    • Cython: 0.29.23 -> 0.29.24

    • dask: 2021.6.2 -> 2021.7.2

    • dask-labextension: 5.0.2 -> 5.1.0

    • debugpy: 1.3.0 -> 1.4.1

    • decorator: 4.4.2 -> 5.0.9

    • dictdiffer: 0.8.1 -> 0.9.0

    • distributed: 2021.6.2 -> 2021.7.2

    • dulwich: 0.20.23 -> 0.20.24

    • earthengine-api: 0.1.271 -> 0.1.275

    • eemont: 0.2.3 -> 0.2.5

    • eodag: 2.3.0 -> 2.3.2

    • eodag-cube: 0.1.2 -> 0.2.0

    • eodag-sentinelsat: 0.3.0 -> 0.4.0

    • erddapy: 1.0.0 -> 1.1.0

    • esda: 2.3.6 -> 2.4.1

    • everett: 1.0.3 -> 2.0.0

    • flax: 0.3.3 -> 0.3.4

    • fsspec: 2021.6.1 -> 2021.7.0

    • gcsfs: 2021.6.1 -> 2021.7.0

    • geemap: 0.8.17 -> 0.8.18

    • GeoAlchemy2: 0.9.1 -> 0.9.3

    • geopy: 2.1.0 -> 2.2.0

    • glue-core: 1.0.1 -> 1.1.0

    • glue-vispy-viewers: 1.0.2 -> 1.0.3

    • glueviz: 1.0.0 -> 1.1.0

    • google-api-core: 1.30.0 -> 1.31.1

    • google-auth: 1.32.0 -> 1.34.0

    • google-auth-oauthlib: 0.4.4 -> 0.4.5

    • google-cloud-core: 1.7.1 -> 1.7.2

    • google-cloud-storage: 1.39.0 -> 1.41.1

    • google-resumable-media: 1.3.1 -> 1.3.3

    • holoviews: 1.14.4 -> 1.14.5

    • hvplot: 0.7.2 -> 0.7.3

    • importlib-metadata: 4.6.0 -> 4.6.3

    • importlib-resources: 5.2.0 -> 5.2.2

    • ipyevents: 0.8.2 -> 0.9.0

    • ipykernel: 5.5.5 -> 6.0.3

    • ipython: 7.25.0 -> 7.26.0

    • isort: 5.9.1 -> 5.9.3

    • jax: 0.2.10 -> 0.2.18

    • jaxlib: 0.1.60 -> 0.1.69

    • jeepney: 0.6.0 -> 0.7.1

    • jsonpath-ng: 1.5.2 -> 1.5.3

    • jupyter-lsp: 1.3.0 -> 1.4.1

    • jupyter-packaging: 0.10.3 -> 0.10.4

    • jupyter-server: 1.9.0 -> 1.10.2

    • jupyter-server-proxy: 3.0.2 -> 3.1.0

    • jupyterhub: 1.4.0 -> 1.4.2

    • jupyterlab: 3.0.16 -> 3.1.2

    • jupyterlab-git: 0.30.1 -> 0.32.0

    • jupyterlab-lsp: 3.7.0 -> 3.8.1

    • jupyterlab-server: 2.6.0 -> 2.6.2

    • jupyterlab-spellchecker: 0.6.0 -> 0.7.0

    • keyrings.alt: 4.0.2 -> 4.1.0

    • laspy: 2.0.1 -> 2.0.2

    • leafmap: 0.3.2 -> 0.4.1

    • llvmlite: 0.36.0 -> 0.37.0rc2

    • mapclassify: 2.4.2 -> 2.4.3

    • marshmallow: 3.12.1 -> 3.13.0

    • mlflow: 1.18.0 -> 1.19.0

    • msal: 1.12.0 -> 1.13.0

    • networkit: 8.1 -> 9.0

    • networkx: 2.5.1 -> 2.6.2

    • numba: 0.53.1 -> 0.54.0rc2

    • onnx: 1.8.0 -> 1.10.0

    • onnxruntime: 1.7.0 -> 1.8.1

    • opencv-contrib-python: 4.5.2 -> 4.5.3

    • opencv-contrib-python-headless: 4.5.2 -> 4.5.3

    • opencv-python: 4.5.2 -> 4.5.3

    • opencv-python-headless: 4.5.2 -> 4.5.3

    • optuna: 2.8.0 -> 2.9.1

    • packaging: 20.9 -> 21.0

    • pandas: 1.2.5 -> 1.3.1

    • panel: 0.11.3 -> 0.12.0

    • param: 1.10.1 -> 1.11.1

    • Pillow: 8.2.0 -> 8.3.1

    • pipdeptree: 2.0.0 -> 2.1.0

    • planetary-computer: 0.2.2 -> 0.3.0rc3

    • pyarrow: 4.0.1 -> 5.0.0

    • pybind11: 2.6.2 -> 2.7.1

    • pybind11-global: 2.6.2 -> 2.7.1

    • pydantic: 1.7.4 -> 1.8.2

    • pylint: 2.9.0 -> 2.9.6

    • pyopencl: 2021.2.5 -> 2021.2.6

    • PyQt-builder: 1.10.1 -> 1.10.3

    • pyqtgraph: 0.12.1 -> 0.12.2

    • pysal: 2.4.0 -> 2.5.0

    • pystac: 0.5.6 -> 1.1.0

    • pystac-client: 0.1.1 -> 0.2.0

    • python-dotenv: 0.18.0 -> 0.19.0

    • python-igraph: 0.9.1 -> 0.9.4

    • python-json-logger: 2.0.1 -> 2.0.2

    • pyviz-comms: 2.0.2 -> 2.1.0

    • pyzmq: 22.1.0 -> 22.2.0

    • qasync: 0.16.0 -> 0.18.0

    • rdflib: 5.0.0 -> 6.0.0

    • regex: 2021.4.4 -> 2021.8.3

    • rio-cogeo: 2.3.0 -> 2.3.1

    • rioxarray: 0.4.3 -> 0.6.1

    • ruamel.yaml.clib: 0.2.4 -> 0.2.6

    • s3fs: 2021.6.1 -> 2021.7.0

    • s3transfer: 0.3.7 -> 0.4.2

    • scipy: 1.7.0 -> 1.7.1

    • scitools-iris: 3.0.2 -> 3.0.4

    • setuptools: 57.0.0 -> 57.4.0

    • simplejson: 3.17.2 -> 3.17.3

    • skl2onnx: 1.8.0 -> 1.9.0

    • spacy: 3.0.6 -> 3.1.1

    • spacy-legacy: 3.0.6 -> 3.0.8

    • spatialpandas: 0.4.1 -> 0.4.2

    • Sphinx: 4.0.2 -> 4.1.2

    • splot: 1.1.3 -> 1.1.4

    • SQLAlchemy: 1.4.20 -> 1.4.22

    • tenacity: 7.0.0 -> 8.0.1

    • tensorflow-addons: 0.12.1 -> 0.13.0

    • tensorflow-datasets: 4.3.0 -> 4.4.0

    • tensorflow-metadata: 1.1.0 -> 1.2.0

    • texttable: 1.6.3 -> 1.6.4

    • thinc: 8.0.6 -> 8.0.8

    • threadpoolctl: 2.1.0 -> 2.2.0

    • tifffile: 2021.6.14 -> 2021.7.30

    • tobler: 0.8.0 -> 0.8.2

    • torch: 1.8.1 -> 1.9.0

    • torch-scatter: 2.0.7 -> 2.0.8

    • torch-sparse: 0.6.10 -> 0.6.11

    • torchinfo: 0.1.5 -> 1.5.2

    • torchvision: 0.9.1 -> 0.10.0

    • tqdm: 4.61.1 -> 4.62.0

    • trimesh: 3.9.20 -> 3.9.26

    • trollimage: 1.15.0 -> 1.15.1

    • vispy: 0.6.6 -> 0.7.3

    • wurlitzer: 2.1.0 -> 2.1.1

    • xarray: 0.18.2 -> 0.19.0

    • xarray-leaflet: 0.1.13 -> 0.1.15

    • xarray-spatial: 0.2.6 -> 0.2.7

    • XlsxWriter: 1.4.3 -> 1.4.5

    • xmitgcm: 0.5.1 -> 0.5.2

    • zipp: 3.4.1 -> 3.5.0

2021/07/02

  • NVIDIA Jetson AGX units belonging to the NRS department are detached from the platform for ESA Space App Camp.

2021/07/01

  • New unit: 21th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-21). Cluster size: 168 CPU, 672 GB RAM.

  • New unit: 22th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-22). Cluster size: 176 CPU, 704 GB RAM.

2021/06/30

  • New unit: 19th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-19). Cluster size: 152 CPU, 608 GB RAM.

  • New unit: 20th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-20). Cluster size: 160 CPU, 640 GB RAM.

2021/06/24

  • New unit: 18th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-18). Cluster size: 144 CPU, 576 GB RAM.

2021/06/15

  • New service: Daily scan trojans, viruses, malware, and other malicious threats is enabled for the home directories (Powered by ClamAV).

2021/06/14

  • New data: SRTM

  • New data: GMTED2010

  • New data: SPAM

2021/06/04

  • New unit: 1st NVIDIA Jetson Nano unit is added to the cluster (jetson-nano-1) (EXPERIMENTAL)

2021/06/02

  • PowerEdge T320 (moon) upgraded from 16 GB to 192 GB.

  • External WD 10TB hard disks are shucked and converted into 20 TB replicated RAIDZ 2+1 (ZFS).

  • HDFS capacity is upgraded from 4 TB to 20 TB.

2021/06/01

Regular platform upgrade

  • New Python packages

    • chex: 0.0.7

    • jupyter-archive: 3.0.1

    • matplotlib-inline: 0.1.2

    • optax: 0.0.6

  • Removed Python packages

    • pyerfa: 1.7.3

  • Upgraded Python packages

    • anyio: 3.0.1 -> 3.1.0

    • AnyQt: 0.0.11 -> 0.0.13

    • attrs: 20.3.0 -> 21.2.0

    • bokeh: 2.3.1 -> 2.3.2

    • bqplot: 0.12.26 -> 0.12.28

    • cachetools: 4.2.1 -> 4.2.2

    • catalogue: 2.0.3 -> 2.0.4

    • certifi: 2020.12.5 -> 2021.5.30

    • cf-units: 2.1.4 -> 2.1.5

    • cliff: 3.7.0 -> 3.8.0

    • cligj: 0.7.1 -> 0.7.2

    • clustering-geodata-cubes: 0.2.1 -> 0.3.0

    • comet-ml: 3.9.0 -> 3.11.0

    • dask: 2021.4.0 -> 2021.5.1

    • dask-labextension: 5.0.1 -> 5.0.2

    • dask-ml: 1.8.0 -> 1.9.0

    • distributed: 2021.4.0 -> 2021.5.1

    • dulwich: 0.20.21 -> 0.20.23

    • earthengine-api: 0.1.265 -> 0.1.268

    • et-xmlfile: 1.0.1 -> 1.1.0

    • findlibs: 0.0.1 -> 0.0.2

    • Flask: 1.1.2 -> 1.1.4

    • flax: 0.3.3 -> 0.3.4

    • GDAL: 3.2.2 -> 3.2.3

    • GitPython: 3.1.14 -> 3.1.17

    • google-api-core: 1.26.3 -> 1.29.0

    • google-auth: 1.29.0 -> 1.30.1

    • google-cloud-bigquery: 2.13.1 -> 2.18.0

    • google-cloud-storage: 1.37.1 -> 1.38.0

    • google-resumable-media: 1.2.0 -> 1.3.0

    • greenlet: 1.0.0 -> 1.1.0

    • holoviews: 1.14.3 -> 1.14.4

    • horovod: 0.21.3 -> 0.22.0

    • imageio-ffmpeg: 0.4.3 -> 0.4.4

    • importlib-metadata: 4.0.1 -> 4.5.0

    • importlib-resources: 5.1.2 -> 5.1.4

    • ipython: 7.22.0 -> 7.24.1

    • jax: 0.2.9 -> 0.2.13

    • jupyter-bokeh: 3.0.0 -> 3.0.2

    • jupyter-lsp: 1.2.0 -> 1.3.0

    • jupyter-server: 1.7.0 -> 1.8.0

    • jupyter-server-mathjax: 0.2.2 -> 0.2.3

    • jupyterlab: 3.0.15 -> 3.0.16

    • jupyterlab-lsp: 3.6.0 -> 3.7.0

    • jupyterlab-server: 2.5.1 -> 2.6.0

    • jupyterlab-spellchecker: 0.5.2 -> 0.6.0

    • MarkupSafe: 1.1.1 -> 2.0.1

    • matplotlib: 3.4.1 -> 3.4.2

    • mlflow: 1.15.0 -> 1.17.0

    • momepy: 0.4.3 -> 0.4.4

    • mxnet: 1.7.0 -> 1.8.0

    • nbclassic: 0.2.8 -> 0.3.1

    • nbdime: 3.0.0 -> 3.1.0

    • nbsphinx: 0.8.5 -> 0.8.6

    • notebook: 6.3.0 -> 6.4.0

    • numbagg: 0.1 -> 0.2.1

    • onnxruntime: 1.6.0 -> 1.7.0

    • onnxruntime-gpu: 1.6.0 -> 1.7.0

    • onnxruntime-gpu-tensorrt: 1.6.0 -> 1.7.0

    • opencv-contrib-python: 4.5.1 -> 4.5.2

    • opencv-contrib-python-headless: 4.5.1 -> 4.5.2

    • opencv-python: 4.5.1 -> 4.5.2

    • opencv-python-headless: 4.5.1 -> 4.5.2

    • openTSNE: 0.5.2 -> 0.6.0

    • orange-canvas-core: 0.1.19 -> 0.1.20

    • orange-widget-base: 4.12.0 -> 4.13.1

    • Orange3: 3.28.0 -> 3.29.1

    • osmnx: 1.0.1 -> 1.1.1

    • OWSLib: 0.23.0 -> 0.24.1

    • pathy: 0.4.0 -> 0.5.2

    • pbr: 5.5.1 -> 5.6.0

    • pip: 21.0.1 -> 21.1.2

    • prometheus-flask-exporter: 0.18.1 -> 0.18.2

    • protobuf: 3.15.8 -> 3.17.1

    • pydantic: 1.7.3 -> 1.7.4

    • pydocstyle: 6.0.0 -> 6.1.1

    • pylint: 2.8.2 -> 2.8.3

    • pyopencl: 2021.1.6 -> 2021.2.2

    • PyQt-builder: 1.9.1 -> 1.10.0

    • PyQt5-sip: 12.8.1 -> 12.9.0

    • pytest: 6.2.3 -> 6.2.4

    • pytest-cov: 2.11.1 -> 2.12.0

    • python-igraph: 0.8.3 -> 0.9.1

    • python-slugify: 4.0.1 -> 5.0.2

    • pytools: 2021.2.3 -> 2021.2.7

    • pyzmq: 22.0.3 -> 22.1.0

    • qasync: 0.15.0 -> 0.16.0

    • rasterio: 1.2.2 -> 1.2.3

    • rfc3986: 1.4.0 -> 1.5.0

    • ruamel.yaml: 0.17.4 -> 0.17.7

    • scikit-learn: 0.24.1 -> 0.24.2

    • scipy: 1.6.2. -> 1.6.3

    • scitools-iris: 3.0.1 -> 3.0.2

    • setuptools: 56.0.0. -> 57.0.0

    • sortedcontainers: 2.3.0 -> 2.4.0

    • spacy: 3.0.5 -> 3.0.6

    • spacy-legacy: 3.0.4 -> 3.0.5

    • Sphinx: 4.0.1 -> 4.0.2

    • sphinxcontrib-htmlhelp: 1.0.3 -> 2.0.0

    • sphinxcontrib-serializinghtml: 1.1.4 -> 1.1.5

    • SQLAlchemy: 1.4.11 -> 1.4.17

    • tensorboard-data-server: 0.6.0 -> 0.6.1

    • tensorflow-datasets: 4.2.0 -> 4.3.0

    • tensorflow-metadata: 0.30.0 -> 1.0.0

    • terminado: 0.9.5 -> 0.10.0

    • testpath: 0.4.4 -> 0.5.0

    • tomlkit: 0.7.0 -> 0.7.2

    • torch: 1.7.0 -> 1.8.1

    • torchinfo: 0.0.9 -> 0.1.3

    • torchvision: 0.8.0 -> 0.9.1

    • tqdm: 4.60.0 -> 4.61.0

    • trimesh: 3.9.18 -> 3.9.20

    • twitter: 1.18.0 -> 1.19.2

    • typeguard: 2.12.0 -> 2.12.1

    • urllib3: 1.26.4 -> 1.26.5

    • websocket-client: 0.58.0 -> 1.0.1

    • xarray: 0.17.0 -> 0.18.2

    • xgboost: 1.3.3 -> 1.4.2

    • XlsxWriter: 1.3.9 -> 1.4.3

    • zarr: 2.7.1 -> 2.8.3

  • Downgraded Python packages:

    • astropy: 4.2.1 -> 4.0.5

    • fast-histogram: 0.9 -> 0.7

    • freetype-py: 2.2.0 -> 2.1.0.post1

    • vispy: 0.6.6 -> 0.6.1

2021/05/21

  • New application: Firefox - Safe and easy web browser from Mozilla

  • New JupyterLab extension: jupyter-archive - A Jupyter/Jupyterlab extension to make, download and extract archive files.

2021/05/19

  • New unit: 15th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-15). Cluster size: 120 CPU, 480 GB RAM.

  • New unit: 16th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-16). Cluster size: 128 CPU, 512 GB RAM.

  • New unit: 17th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-17). Cluster size: 136 CPU, 544 GB RAM.

2021/05/04

  • New unit: 13th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-13). Cluster size: 104 CPU, 416 GB RAM.

  • New unit: 14th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-14). Cluster size: 112 CPU, 448 GB RAM.

  • New unit: Dell PowerEdge T320, Intel Xeon E5-2420 v2 @ 2.20 GHz, 6 cores, 12 threads, 16 GB (moon)

  • New unit: Dell PowerEdge R730xd, Intel Xeon E5-2640 v3 @ 2.60 GHz, 16 cores (2 sockets), 32 threads, 768 GB (mercury)

2021/04/29

  • New application: Pandoc - A universal document converter

  • New application: Sphinx - A tool that makes it easy to create intelligent and beautiful documentation

  • New Python packages

    • nbsphinx (0.8.3) - Jupyter Notebook Tools for Sphinx

2021/04/28

2021/04/24

  • New application: COLMAP: General-purpose Structure-from-Motion (SfM) and Multi-View Stereo (MVS) pipeline

  • New Python packages

    • flax (0.3.3)

    • imageio-ffmpeg (0.4.3)

    • ipyplot (1.1.0)

    • OpenEXR (1.3.2)

    • pycolmap (0.0.1)

    • shortuuid: 1.0.1

    • tensorflow-graphics (2020.5.20)

    • trimesh (3.9.14)

2021/04/22

Regular platform update

  • New Python packages

    • deprecation: 2.1.0

    • jupyter-packaging: 0.9.2

    • pybind11-global: 2.6.2

    • tensorboard-data-server: 0.6.0

    • tomlkit: 0.7.0

  • Removed Python packages

    • ftfy (5.9)

    • torchcontrib (0.0.2)

  • Upgraded Python packages

    • arcgis: 1.8.5 -> 1.8.5.post3

    • bqplot: 0.12.25 -> 0.12.26

    • catalogue: 2.0.1 -> 2.0.3

    • colorlog: 4.8.0 -> 5.0.1

    • comet-ml: 3.8.1 -> 3.9.0

    • Cython: 0.29.22 -> 0.29.23

    • dm-tree: 0.1.5 -> 0.1.6

    • docutils: 0.17 -> 0.17.1

    • earthengine-api: 0.1.260 -> 0.1.262

    • eccodes: 1.3.0 -> 1.3.2

    • fsspec: 0.9.0 -> 2021.4.0

    • geemap: 0.8.13 -> 0.8.14

    • google-auth: 1.28.1 -> 1.29.0

    • importlib-metadata: 3.10.0 -> 4.0.1

    • jupyter-server: 1.6.0 -> 1.6.4

    • mercantile: 1.1.6 -> 1.2.1

    • openTSNE: 0.5.1 -> 0.5.2

    • pandas: 1.2.3 -> 1.2.4

    • panel: 0.11.2 -> 0.11.3

    • py-cpuinfo: 7.0.0 -> 8.0.0

    • quantecon: 0.4.8 -> 0.5.0

    • sacremoses: 0.0.44 -> 0.0.45

    • spacy-legacy: 3.0.2 -> 3.0.4

    • spacy-transformers: 1.0.1 -> 1.0.2

    • SQLAlchemy: 1.4.7 -> 1.4.11

    • srsly: 2.4.0 -> 2.4.1

    • tensorboard: 2.4.1 -> 2.5.0

    • tensorflow-hub: 0.11.0 -> 0.12.0

    • tensorflow-metadata: 0.29.0 -> 0.30.0

    • thinc: 8.0.2 -> 8.0.3

    • tokenizers: 0.9.4 -> 0.10.2

    • transformers: 4.2.2 -> 4.5.1

    • voila: 0.2.7 -> 0.2.9

    • whitebox: 1.4.0 -> 1.4.1

    • XlsxWriter: 1.3.8 -> 1.3.9

    • xxhash: 2.0.0 -> 2.0.2

    • zarr: 2.7.0 -> 2.7.1

2021/04/20

  • Export/import and backup support enabled for pgAdmin

  • Updated services:

    • pgAdmin: 5.0 -> 5.1

2021/04/09

  • Tcl/tk support enabled for R

  • New R packages:

    • soilassessment (0.2.1)

    • geojsonio (0.9.4)

    • V8 (3.4.0)

2021/04/06

Regular platform update

  • Upgraded applications

    • R: 4.0.3 -> 4.0.5

    • Go: 1.15.6 -> 1.16.3

    • Julia: 1.5.3 -> 1.5.4

    • Java: 11.0.9.1 -> 11.0.10

  • New Python packages

    • Babel (2.9.0)

    • cudf (0.19)

    • cuspatial (0.19)

    • dask-cudf (0.19)

    • greenlet (1.0.0)

    • importlib-metadata (3.10.0)

    • jupyter-packaging (0.7.12)

    • nbclassic (0.2.6)

    • nvtx (0.2.3)

    • pyarrow (1.0.1)

    • rmm (0.19.0)

    • zipp (3.4.1)

2021/02/28

  • New application: PostGIS loaders (raster2pgsql, shp2pgsql, pgsql2shp)

2021/02/18

  • New application: ImageMagick - Software suite for displaying, creating, converting, modifying, and editing raster images (7.0.10-62)

2021/02/16

  • New unit: 11th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-11). Cluster size: 88 CPU, 352 GB RAM.

  • New unit: 12th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-12). Cluster size: 96 CPU, 384 GB RAM.

2021/02/15

It was challenging, but the transition from Python 3.6 to 3.8 is completed.

You local packages (e.g. installed by pip) are also upgraded. Please check if they function properly and if not, just let us know.

  • New packages

    • amply (0.1.4)

    • anyio (2.1.0)

    • blessings (1.7)

    • bqplot (0.12.22)

    • chainer (7.7.0)

    • classification-models (0.1)

    • cliff (3.6.0)

    • clustering-geodata-cubes (0.2.1)

    • cmaes (0.8.1)

    • cmd2 (1.5.0)

    • colorcet (2.0.6)

    • colorlog (4.7.2)

    • colour (0.1.5)

    • comet-ml (3.3.3)

    • configobj (5.0.6)

    • dask-glm (0.2.0)

    • dask-ml (1.8.0)

    • dulwitch (0.20.19)

    • earthengine-api (0.1.251)

    • everett (1.0.3)

    • ffmpeg-python (0.2.0)

    • future (0.18.2)

    • geeadd (0.5.3)

    • geemap (0.8.9)

    • geocoder (1.38.1)

    • google-api-core (1.26.0)

    • google-api-python-client (1.12.8)

    • google-auth (1.26.1)

    • google-auth-httplib2 (0.0.4)

    • google-cloud-core (1.6.0)

    • google-cloud-storage (1.36.0)

    • google-crc32c (1.1.2)

    • google-resumable-media (1.2.0)

    • googleapis-common-protos (1.52.0)

    • holoviews (1.14.1)

    • httplib2 (0.19.0)

    • httplib2shim (0.0.3)

    • iniconfig (1.1.1)

    • ipyevents (0.8.1)

    • ipyfilechooser (0.4.2)

    • ipynb-py-convert (0.4.6)

    • ipython-autotime (0.3.1)

    • ipytree (0.1.8)

    • jupyter-server (1.3.0)

    • keras-tqdm (2.0.1)

    • livelossplot (0.5.4)

    • logzero (1.6.3)

    • mss (6.1.0)

    • multipledispatch (0.6.0)

    • netifaces (0.10.9)

    • networkit (8.0)

    • nose (1.3.7)

    • onnxmltools (1.7.0)

    • onnxruntime-gpu-tensorrt (1.6.0)

    • opencv-contrib-python (4.5.1)

    • opencv-contrib-python-headless (4.5.1)

    • opencv-python (4.5.1)

    • opencv-python-headless (4.5.1)

    • optuna (2.5.0)

    • osmnx (1.0.1)

    • panel (0.10.3)

    • param (1.10.1)

    • pbr (5.5.1)

    • pluggy (0.13.1)

    • pointpats (2.2.0)

    • prettytable (0.7.2)

    • PuLP (2.4)

    • py (1.10.0)

    • Py6S (1.8.0)

    • pycocotools (2.0.2)

    • pycosat (0.6.3)

    • PyCRS (1.0.2)

    • pyct (0.4.8)

    • pygmt (0.3.0)

    • pyperclip (1.8.1)

    • pysal (2.4.0)

    • Pysolar (0.6)

    • pytest (6.2.2)

    • pytest-cov (2.11.1)

    • pyviz-comms (2.0.1)

    • ratelim (0.1.6)

    • requests-toolbelt (0.9.1)

    • skl2onnx (1.7.0)

    • spopt (0.1.1)

    • ssim (0.3.0)

    • stevedore (3.3.0)

    • torchinfo (0.0.6)

    • twitter (1.18.0)

    • uritemplate (3.0.1)

    • voila (0.2.6)

    • whitebox (1.4.9)

    • whiteboxgui (0.1.9)

    • wurlitzer (2.0.1)

  • Upgraded packages (major ones are indicated in bold):

    • absl-py: 0.10.0 -> 0.11.0

    • cachetools: 4.2.0 -> 4.2.1

    • cffi: 1.14.4 -> 1.14.5

    • contextily: 1.0.1 -> 1.1.0

    • coverage: 5.3.1 -> 5.4

    • cryptography: 3.4.2 -> 3.4.5

    • cupy: 8.3.0 -> 8.4.0

    • dask: 2020.12.0 -> 2021.2.0

    • distributed: 2020.12.0 -> 2021.2.0

    • docker: 4.4.1 -> 4.4.2

    • esda: 2.3.5 -> 2.3.6

    • folium: 0.12.0 -> 0.12.1

    • GDAL: 3.2.0 -> 3.2.1

    • geopandas: 0.8.1 -> 0.8.2

    • GitPython: 3.1.12 -> 3.1.13

    • google-auth: 1.24.0 -> 1.26.1

    • ipython: 7.16.1 -> 7.20.0

    • Jinja2: 2.11.2 -> 2.11.3

    • joblib: 1.0.0 -> 1.0.1

    • libpysal: 4.3.0 -> 4.4.0

    • locket: 0.2.0 -> 0.2.1

    • Mako: 1.1.3 -> 1.1.4

    • matplotlib: 3.3.3 -> 3.3.4

    • momepy: 0.4.1 -> 0.4.2

    • mxnet: 1.6.0 -> 1.7.0

    • nbclient: 0.5.1 -> 0.5.2

    • netCDF4: 1.5.5.1 -> 1.5.6

    • numcodecs: 0.7.2 -> 0.7.3

    • numpy: 1.18.5 -> 1.19.5

    • onnxruntime-gpu: 1.5.2 -> 1.6.0

    • OWSLib: 0.21.0 -> 0.23.0

    • packaging: 20.8 -> 20.9

    • pandas: 1.1.5 -> 1.2.2

    • pip: 20.3.3 -> 21.0.1

    • prompt-toolkit: 3.0.14 -> 3.0.16

    • pybind11: 2.6.1 -> 2.6.2

    • pygraphviz: 1.6 -> 1.7

    • pyopencl: 2020.3.1 -> 2021.1.1

    • pyshp: 2.1.2 -> 2.1.3

    • pytools: 2020.4.4 -> 2021.1

    • pytz: 2020.5 -> 2021.1

    • pyzmq: 22.0.2 -> 22.0.3

    • rasterio: 1.1.8 -> 1.2.0

    • rsa: 4.6 -> 4.7

    • scikit-image: 0.17.2 -> 0.18.1

    • scikit-learn: 0.24.0 -> 0.24.1

    • scipy: 1.5.4 -> 1.6.0

    • scitools-iris: 2.4.0 -> 3.0.1

    • SecretStorage: 3.3.0 -> 3.3.1

    • setuptools: 51.1.1 -> 52.0.0

    • spreg: 1.1.2.post1 -> 1.2.2

    • SQLAlchemy: 1.3.22 -> 1.3.23

    • statsmodels: 0.12.1 -> 0.12.2

    • tensorboard: 2.4.0 -> 2.4.1

    • tensorboard-plugin-wit: 1.7.0 -> 1.8.0

    • tensorflow: 2.3.1+nv20.12 -> 2.4.1

    • tensorflow-estimator: 2.3.0 -> 2.4.0

    • tifffile: 2020.9.3 -> 2021.2.1

    • tobler: 0.5.4 -> 0.7.0

    • torchvision: 0.8.0a0+45f960c -> 0.8.0a0+291f7e2

    • tqdm: 4.55.1 -> 4.56.2

    • traitlets: 4.3.3 -> 5.0.5

    • urllib3: 1.26.2 -> 1.26.3

  • Downgraded packages:

    • grpcio: 1.34.0 -> 1.32.0

    • ipyleaflet: 0.13.6 -> 0.13.3

    • python-dateutil: 2.8.1 -> 2.8.0

    • xgboost: 1.4.0-SNAPSHOT -> 1.3.3

  • Removed packages:

    • contextvars: 2.4

    • dataclasses: 0.8

    • gdown: 3.12.2

    • graphsurgeon: 0.4.5

    • idna-ssl: 1.1.0

    • immutables: 0.14

    • importlib-metadata: 3.3.0

    • PySocks: 1.7.1

    • tensorrt: 7.1.3.0

    • uff: 0.6.9

    • zipp: 3.4.0

2021/02/14

Happy Valentine’s Day!

  • New application: QGIS - Open-source cross-platform desktop GIS application (3.16.3)

2021/02/12

Thanks to the NRS Department for sharing their 4th NVIDIA unit on the platform!

  • New unit: 10th NVIDIA Jetson AGX Xavier unit is added to the cluster (jetson-agx-10). Cluster size: 80 CPU, 320 GB RAM.

2021/02/10

  • New application: MLflow - A platform for the machine learning lifecycle (1.13.1)

  • New package: mlflow - A platform for the machine learning lifecycle (1.13.1)

2021/02/08

  • New application: RStudio - Integrated development environment for R (available through VNC)

2021/02/05

  • New application: Orange3 - Interactive data analysis (available through VNC)

2021/02/03

2021/02/02

TightVNC is replaced with TigerVNC, which allows full-size desktop, better visualisation (e.g. windows decorations), and password-less access.

  • New application: TigerVNC - High-performance, platform-neutral implementation of VNC (1.11.0)

  • Removed applications:

    • TightVNC (1.3.10)

2021/01/30

Now it is also possible to run desktop applications on the platform! XFCE Desktop Environment is accessible through noVNC (password = test1234).

  • New application: noVNC - Open-source VNC client (1.2.0)

  • New application: TightVNC - Lightweight, fast and reliable remote desktop software (1.3.10)

  • New application: XFCE - Lightweight desktop environment for UNIX-like operating systems (4.14)

2021/01/29

PyTorch with GPU support is available on the platform!

  • New package: albumentations - Fast image augmentation library and easy to use wrapper around other libraries (0.5.2)

  • New package: efficientnet - EfficientNet model re-implementation (1.0.0)

  • New package: image-classifiers - Image classification models (1.0.0)

  • New package: imgaug - Image augmentation library for deep neural networks (0.4.0)

  • New package: Keras-Applications - Reference implementations of popular deep learning models (1.0.8)

  • New package: osmxtract - Extract vector and raster data from OSM (0.0.1)

  • New package: segmentation-models - Image segmentation models with pre-trained backbones with Keras (1.0.1)

  • New package: torch - Tensors and Dynamic neural networks in Python with strong GPU acceleration (1.7.0a0)

  • New package: torchvision - Image and video datasets and models for torch deep learning (0.8.0a0)

  • Upgraded packages:

    • pyzmq: 21.0.2 -> 22.0.2

2021/01/28

  • New package: flatbuffers - The FlatBuffers serialization format for Python (1.12)

  • New package: jax - Differentiate, compile, and transform Numpy code (0.2.9)

  • New package: jaxlib - XLA library for JAX (0.1.60)

  • Upgraded packages:

    • alembic: 1.4.3 -> 1.5.2

    • bleach: 3.2.1 -> 3.2.3

2021/01/27

Debugging support for Python is available on the platform! You can use debugging panel (on the left sidebar) with Xeus Python (XPython) kernel.

  • New kernel: Xeus Python (XPython) - Jupyter kernel for Python based on the native implementation of the Jupyter protocol xeus. You can use the debugger with XPython.

  • New package: debugpy - An implementation of the Debug Adapter Protocol for Python (1.2.1)

  • New package: ptvsd - Remote debugging server for Python (4.3.2)

  • New package: pipdeptree - Command line utility to show dependency tree of packages (2.0.0)

  • Upgraded packages:

    • ipykernel: 5.4.2 -> 5.4.3

    • jupyter-client: 6.1.7 -> 6.1.11

    • nbformat: 5.0.8 -> 5.1.2

    • nest-asyncio: 1.4.3 -> 1.5.1

    • notebook: 6.1.6 -> 6.2.0

    • prompt-toolkit: 3.0.9 -> 3.0.14

2021/01/26

  • New package: ann-visualizer - A python library for visualizing Neural Networks (2.5)

  • New package: crick - High performance approximate and streaming algorithms (0.0.3)

  • New package: fire - A library for automatically generating command line interfaces (0.4.0)

  • New package: keras-segmentation - Image Segmentation toolkit for keras (0.3.0)

  • New package: keras2onnx - Converts Machine Learning models to ONNX (1.7.0)

  • New package: onnx - Open Neural Network Exchange (1.8.0)

  • New package: onnxconverter-common - ONNX Converter and Optimization Tools (1.7.0)

  • New package: onnxruntime - ONNX Runtime Python bindings (1.6.0)

2021/01/25

  • New package: momepy - Urban Morphology Measuring Toolkit (0.4.1)

  • New package: pygeos - GEOS wrapped in numpy ufuncs (0.8)

  • Upgraded packages:

    • pyproj: 2.5.0 -> 2.6.1

    • pyzmq: 20.0.0 -> 21.0.2

    • qtconsole: 5.0.1 -> 5.0.2

    • smmap: 3.0.4 -> 3.0.5