Below you will find pages that utilize the taxonomy term “NOMAD CoE”
December 22, 2019
Meta Info Tools
The meta info was at the hearth of the NOMAD Archive, as a way to make the data available. The NOMAD meta info is an extensible language independent and format agnostic description of atomistic simulation data.
Recently I rewrote the tools to manage the meta info in python 3, improved them and generally tried to take advantage of the lesson learned.
pip install meta_into_tools python -m meta_info_tools.meta_tools --help See the meta info page for more details.
read morePresentations
Workflows in NOMAD
Workflows in NOMAD, presented at the Workshop for reproducible workflows
read moreApril 10, 2019
Bringing Back Kubernetes
Bringing Back Kubernetes The problem Shortly after having had my last day of work some issues came up and the kubernetes cluster went down. I began looking into it (a bit half heartily) and I began noticing some strange random issues. Monitoring the kube-system namespace I saw that flannel issues seemed to crop up quickly. There are several issues open regarding flannel failing #963, 1076,… and initially the real culprit wasn’t clear.
read moreNOMAD
NOMAD
After 3 years the NOMAD Center of Exellence officially finished. There was lots of good work so it is a good moment to look at good things coming out of its development, that I was involved in. I call these NOMAD Gems.
Here are some resources describing the infrastructure, who worked on it and the experience we gathered.
The posts with the tag nomad are also related to it.
read moreNOMAD
NOMAD Infrastructure
Description of the infrastructure of the NOMAD Archive and BigData analytics.
read moreDecember 17, 2018
NOMAD Prod Kubernetes Reinstall
Reinstalling the Kubernetes Production Cluster The main reason for this is a critical Kubernetes bug. Here is a bit a log of what I did (to hopefully help me next time). This is mostly taken from kubernetes doc (1, 2) and tweaks I added.
Master node: Basically the same as the Visualization Setup minus the tainting and coredns editing:
# disable swap: swapoff -a # comment out swap lines (the command should do it, but I prefer manual edit) # sudo sed -i '/ swap / s/^\(.
read moreDecember 15, 2018
NOMAD Dev Kubernetes Extension
Dev Kubernetes reinstall The main reason for this is a critical Kubernetes bug. Here is a bit a log of what I did (to hopefully help me next time).
Development cluster extension I installed a new cluster on labdev3, mostly following what I did last time. But labdev4 was having issues, so I asked a clean image. It took a bit to have it up. Here is the process to add it to the Kubernetes cluster.
read moreNOMAD
Container Manager
Description of a flexible platform to start user associated containers providing a service.
read moreNOMAD
Kubernetes
Description of our experience with Docker and Kubernetes as basis of our infrastructure.
read moreNovember 20, 2018
NOMAD Vis Kubernetes Install
Kubernetes Kubernetes is central to NOMAD archive and analytics (see /nomad/Kubernetes).
Every installation of kubernetes has been quite different (kubernetes evolves quickly). Here is the description of the latest (more manual) installation I did on CentOS for the remote visualization, mainly as a reference for me. This uses kubeadm something that has simplified the installation of kubernetes.
update kubeadm (from https://kubernetes.io/docs/setup/independent/install-kubeadm/)
cat <<EOF > /etc/yum.repos.d/kubernetes.repo [kubernetes] name=Kubernetes baseurl=https://packages.cloud.google.com/yum/repos/kubernetes-el7-x86_64 enabled=1 gpgcheck=1 repo_gpgcheck=1 gpgkey=https://packages.
read morePresentations
NOMAD Presentation BBDC 4
My fourth presentation for the Berlin Big Data Center
read morePresentations
NOMAD Presentation BBDC 2
My second presentation for the Berlin Big Data Center
read morePresentations
Nomad Kick-Off
My presentation for Work Package 1 at the Kick-off meeting of NOMAD
read morePresentations
Nomad Repository
One of the first very short internal presentations on the NOMAD Meta Info and Repository I did
read moreNOMAD
NOMAD Meta Info
The metainfo, is the way we describe all quantities extracted in by NOMAD CoE Archive.
read moreNOMAD
NOMAD URIs
Description of the URI used to uniquely identify all data in the NOMAD CoE Archive.
read more