perfsonar-user - RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET
Subject: perfSONAR User Q&A and Other Discussion
List archive
RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET
Chronological Thread
- From: "Whitworth, Luke" <>
- To: "" <>
- Subject: RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET
- Date: Mon, 26 Oct 2020 11:47:10 +0000
- Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cranfield.ac.uk; dmarc=pass action=none header.from=cranfield.ac.uk; dkim=pass header.d=cranfield.ac.uk; arc=none
- Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=63skS2t7z9Yzp+pIMqL6l+adJOoOY+cWbj1L0aq3vCk=; b=M+18wk4NbJBkuQvhb2hMvBNAbr70fVfTvrkg6IkKflsmX5N47GaE4YRGwEI6ZnlOtvMNJIxyT0iEg0rs60DBTaioWkxQ+lBWFSN5J91eMogyTMi+13LewLLPu76REQaCFjUx4IMf4YijTWWwQQLufqHxKZCsSPDkG2aMjxtkj4JEAMSfhDM/0QHPmi3MT/FJfpDjFQ1ncH6lf5rgt+U48dNVVpnybsy/By8bR+Th99jryNOZT3OfM+QQREQ6aWjqW1GheOttK0Bnjsqbo4Na2V9+UYTeEyHmV9gRhP+/HyUpyco1/rtL0/GgDFvb4+v9AFOemS2M/BBOFHjkKPgrtw==
- Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hguLWXQAF/f1UCyGdd8aaCTgseyGuvPTvOckfNy1K2eoRp+W6zC9e0k6AhDC1hAFTwH/9DRpUTmLGwFyauf8QaqflZD4rmJmxuvQn5VnNOpoOfPg/Nhjbdc9fOvf+BRE3vEXsEkn++7Iw3lIb627M0CV4ejK797T7Wx5uDa0v5cwSy3vZwuLUQW4FjyDAu6+ogDMH02t26ZfFFPjIVk9RXQPE1xfC6YcYRlnvTRapDV4FH/dtkrZPRFlMlAGn9x4CoS06I/+ww5UJrBx2TtjYBskXb7kavRrsRgDp/PXUxXG9qTBTsMhvjkeoOg4be3OonxTYRkjTrK8HCS/I5y6MQ==
- Msip_labels: MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_ActionId=738968c3-7ed4-46ac-90d2-d51f07e01a76;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_ContentBits=0;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_Enabled=true;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_Method=Standard;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_Name=Internal Business;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_SetDate=2020-10-26T11:34:10Z;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_SiteId=31dca259-f714-4c48-ba5c-aa96dcf60aaa;
We are in the process of installing Pi’s around our campus with them talking back to a central Esmond DB doing simple latency tests as a mesh.
Left unchecked we could destroy an SD card in about a week with the frequent writes a testpoint does (logging and postgres) so we ended up having to make the Pi filesystem read only.
What we did was create an Ansible playbook for the Pi’s that installed the Perfsonar-testpoint package from the repo, got the Pi to pull in published test definitions from a central URL, disabled almost all logging (redirected things to /dev/null, disabled rsyslog, limited journald ram usage etc.) to conserve RAM (as the overlayfs uses a tmpfs to store modifications) and then used raspi-config to enable the RO filesystem. This now appears to be working quite happily for our use case.
I also have an ansible playbook that I can call to toggle the Pi’s back to read-write if I want to modify anything, then I can use the same playbook to put them back to read-only when I’m done.
I also put watchdog on them so that if any of the personar services stopped working it rebooted the Pi….mainly because early on before I got a handle on the RAM exhaustion they’d occasionally run out and then things would go a bit wobbly. These days they sit at 800MB – 900MB free constantly (that’s on a 2GB RAM Pi).
Hope that’s some help,
Luke
From: <>
On Behalf Of Michael Tiernan
A followup sort of question for those on the list.
On 7/23/20 12:52 PM, Jason Zurawski wrote:
Has anyone worked on a SBC (Raspberry Pi is my current interest) "Target" for some of this testing? I know there's a CPU muscle issue for doing all the heavy lifting PS would impose on a system so I wonder if anyone's thought of creating a simplified target that can respond to tests from a more powerful host? Implementation example might be to facilitate "Work from home" operations where the "Company" could test links out to employee's endpoints for reliability and a modest standard of speed test. (As well as availability.) Plant a simple SBC unit at the target's home and let it respond to test requests from a primary server. It might even be able to do lightweight testing back against the single host but that would just be a plus in the overall design. Thanks for your time. -- << MCT >> Michael C Tiernan +1 (617) 324-9173 | Slack: https://Bates-HPRCF.slack.com MIT-Research Computing Project - http://researchcomputing.mit.edu/ High Perf Research Computing Facility at The Bates Linear Accelerator |
- [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET, Michael Tiernan, 10/23/2020
- RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET, Whitworth, Luke, 10/26/2020
- Re: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET, Mark Feit, 10/27/2020
Archive powered by MHonArc 2.6.19.