Category: CSCS
Category: Slurm
Category: Zig
Category: Thoughts
Category: Ricette
Category: Reads
Reads
Banker to the Poor
A book by Muhammad Yunus and Alan Jolis on the life of M. Yunus and microcredit.
read moreReads
Godel, Escher, Bach: An Eternal Golden Braid
A fantastic book on logic, art and consciousness
read moreCategory: Toughts
October 25, 2020
My Backup script
Nothing like vacation to do and go back to my backup routine and improve it a bit.
I mainly put everything in a script, added the the status and scrub of the backup_freenas_rsync script by K. Raquel Sanborn.
In the script I do not try to handle all contingencies, simply to be careful, and bail out with a helpful error message if things are strange, assuming that then manual intervention will be required.
read moreCategory: NOMAD CoE
December 22, 2019
Meta Info Tools
The meta info was at the hearth of the NOMAD Archive, as a way to make the data available. The NOMAD meta info is an extensible language independent and format agnostic description of atomistic simulation data.
Recently I rewrote the tools to manage the meta info in python 3, improved them and generally tried to take advantage of the lesson learned.
pip install meta_into_tools python -m meta_info_tools.meta_tools --help See the meta info page for more details.
read morePresentations
Workflows in NOMAD
Workflows in NOMAD, presented at the Workshop for reproducible workflows
read moreApril 10, 2019
Bringing Back Kubernetes
Bringing Back Kubernetes The problem Shortly after having had my last day of work some issues came up and the kubernetes cluster went down. I began looking into it (a bit half heartily) and I began noticing some strange random issues. Monitoring the kube-system namespace I saw that flannel issues seemed to crop up quickly. There are several issues open regarding flannel failing #963, 1076,… and initially the real culprit wasn’t clear.
read moreNOMAD
NOMAD
After 3 years the NOMAD Center of Exellence officially finished. There was lots of good work so it is a good moment to look at good things coming out of its development, that I was involved in. I call these NOMAD Gems.
Here are some resources describing the infrastructure, who worked on it and the experience we gathered.
The posts with the tag nomad are also related to it.
read moreNOMAD
NOMAD Infrastructure
Description of the infrastructure of the NOMAD Archive and BigData analytics.
read moreDecember 17, 2018
NOMAD Prod Kubernetes Reinstall
Reinstalling the Kubernetes Production Cluster The main reason for this is a critical Kubernetes bug. Here is a bit a log of what I did (to hopefully help me next time). This is mostly taken from kubernetes doc (1, 2) and tweaks I added.
Master node: Basically the same as the Visualization Setup minus the tainting and coredns editing:
# disable swap: swapoff -a # comment out swap lines (the command should do it, but I prefer manual edit) # sudo sed -i '/ swap / s/^\(.
read moreDecember 15, 2018
NOMAD Dev Kubernetes Extension
Dev Kubernetes reinstall The main reason for this is a critical Kubernetes bug. Here is a bit a log of what I did (to hopefully help me next time).
Development cluster extension I installed a new cluster on labdev3, mostly following what I did last time. But labdev4 was having issues, so I asked a clean image. It took a bit to have it up. Here is the process to add it to the Kubernetes cluster.
read moreNOMAD
Container Manager
Description of a flexible platform to start user associated containers providing a service.
read moreNOMAD
Kubernetes
Description of our experience with Docker and Kubernetes as basis of our infrastructure.
read moreNovember 20, 2018
NOMAD Vis Kubernetes Install
Kubernetes Kubernetes is central to NOMAD archive and analytics (see /nomad/Kubernetes).
Every installation of kubernetes has been quite different (kubernetes evolves quickly). Here is the description of the latest (more manual) installation I did on CentOS for the remote visualization, mainly as a reference for me. This uses kubeadm something that has simplified the installation of kubernetes.
update kubeadm (from https://kubernetes.io/docs/setup/independent/install-kubeadm/)
cat <<EOF > /etc/yum.repos.d/kubernetes.repo [kubernetes] name=Kubernetes baseurl=https://packages.cloud.google.com/yum/repos/kubernetes-el7-x86_64 enabled=1 gpgcheck=1 repo_gpgcheck=1 gpgkey=https://packages.
read morePresentations
NOMAD Presentation BBDC 4
My fourth presentation for the Berlin Big Data Center
read morePresentations
NOMAD Presentation BBDC 2
My second presentation for the Berlin Big Data Center
read morePresentations
Nomad Kick-Off
My presentation for Work Package 1 at the Kick-off meeting of NOMAD
read morePresentations
Nomad Repository
One of the first very short internal presentations on the NOMAD Meta Info and Repository I did
read moreNOMAD
NOMAD Meta Info
The metainfo, is the way we describe all quantities extracted in by NOMAD CoE Archive.
read moreNOMAD
NOMAD URIs
Description of the URI used to uniquely identify all data in the NOMAD CoE Archive.
read moreCategory: Presentation
Presentations
Workflows in NOMAD
Workflows in NOMAD, presented at the Workshop for reproducible workflows
read morePresentations
NOMAD Presentation BBDC 4
My fourth presentation for the Berlin Big Data Center
read morePresentations
NOMAD Presentation BBDC 2
My second presentation for the Berlin Big Data Center
read morePresentations
Nomad Kick-Off
My presentation for Work Package 1 at the Kick-off meeting of NOMAD
read morePresentations
Nomad Repository
One of the first very short internal presentations on the NOMAD Meta Info and Repository I did
read moreCategory: Crypto
April 2, 2000
Criptazione Liceo
Punti sparsi di una lezione che ho dato al liceo sulla criptografia
Privacy alcuni punti riguardo alla protezione della privacy e alla crittografia Motivazione computer registrano tutto -> mancanza di privacy. Soluzioni:
dare le informazioni solo a chi deve riceverle (criptare) dare solo le informazioni necessarie (minimum disclosure arguments) Contesto (e un po' di storia) Antichità - II guerra mondiale Militari, consoli: messaggi cifrati romani p.s. Cesare (shift dell'alfabeto) sparta (striscia di carta su cilindro) in generale permutazione delle lettere II guerra mondiale: Enigma (macchina per cifrare tedesca) .
read moreApril 1, 2000
Merkle's puzzles
Crittografia Crittografia a chiave pubblica Idea -> lucchetto (chiave pubblica, privata)
Esempio Merkle's puzzles Creare un lucchetto (e una chiave) Creare tantissimi problemi risolvibili (ma che necessitano un po' di tempo) e con come risultato due numeri: n e k in modo che n sia 1 per un problema, 2 per un altro, 3 per un alto ancora,...
Tenere a mente che k corrisponde ad ogni n (la chiave privata) Spedire tutti i problemi (ma in sequenza disordinata, casuale) (questa è la chiave pubblica)
read more