Skip to Content.
Sympa Menu

perfsonar-user - RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET

Subject: perfSONAR User Q&A and Other Discussion

List archive

RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET


Chronological Thread 
  • From: "Whitworth, Luke" <>
  • To: "" <>
  • Subject: RE: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET
  • Date: Mon, 26 Oct 2020 11:47:10 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cranfield.ac.uk; dmarc=pass action=none header.from=cranfield.ac.uk; dkim=pass header.d=cranfield.ac.uk; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=63skS2t7z9Yzp+pIMqL6l+adJOoOY+cWbj1L0aq3vCk=; b=M+18wk4NbJBkuQvhb2hMvBNAbr70fVfTvrkg6IkKflsmX5N47GaE4YRGwEI6ZnlOtvMNJIxyT0iEg0rs60DBTaioWkxQ+lBWFSN5J91eMogyTMi+13LewLLPu76REQaCFjUx4IMf4YijTWWwQQLufqHxKZCsSPDkG2aMjxtkj4JEAMSfhDM/0QHPmi3MT/FJfpDjFQ1ncH6lf5rgt+U48dNVVpnybsy/By8bR+Th99jryNOZT3OfM+QQREQ6aWjqW1GheOttK0Bnjsqbo4Na2V9+UYTeEyHmV9gRhP+/HyUpyco1/rtL0/GgDFvb4+v9AFOemS2M/BBOFHjkKPgrtw==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hguLWXQAF/f1UCyGdd8aaCTgseyGuvPTvOckfNy1K2eoRp+W6zC9e0k6AhDC1hAFTwH/9DRpUTmLGwFyauf8QaqflZD4rmJmxuvQn5VnNOpoOfPg/Nhjbdc9fOvf+BRE3vEXsEkn++7Iw3lIb627M0CV4ejK797T7Wx5uDa0v5cwSy3vZwuLUQW4FjyDAu6+ogDMH02t26ZfFFPjIVk9RXQPE1xfC6YcYRlnvTRapDV4FH/dtkrZPRFlMlAGn9x4CoS06I/+ww5UJrBx2TtjYBskXb7kavRrsRgDp/PXUxXG9qTBTsMhvjkeoOg4be3OonxTYRkjTrK8HCS/I5y6MQ==
  • Msip_labels: MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_ActionId=738968c3-7ed4-46ac-90d2-d51f07e01a76;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_ContentBits=0;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_Enabled=true;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_Method=Standard;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_Name=Internal Business;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_SetDate=2020-10-26T11:34:10Z;MSIP_Label_76ec77b0-1566-4e6c-8f07-2f97449b5aa9_SiteId=31dca259-f714-4c48-ba5c-aa96dcf60aaa;

We are in the process of installing Pi’s around our campus with them talking back to a central Esmond DB doing simple latency tests as a mesh.

 

Left unchecked we could destroy an SD card in about a week with the frequent writes a testpoint does (logging and postgres) so we ended up having to make the Pi filesystem read only. 

 

What we did was create an Ansible playbook for the Pi’s that installed the Perfsonar-testpoint package from the repo, got the Pi to pull in published test definitions from a central URL, disabled almost all logging (redirected things to /dev/null, disabled rsyslog, limited journald ram usage etc.) to conserve RAM (as the overlayfs uses a tmpfs to store modifications) and then used raspi-config to enable the RO filesystem.  This now appears to be working quite happily for our use case.

 

I also have an ansible playbook that I can call to toggle the Pi’s back to read-write if I want to modify anything, then I can use the same playbook to put them back to read-only when I’m done.

 

I also put watchdog on them so that if any of the personar services stopped working it rebooted the Pi….mainly because early on before I got a handle on the RAM exhaustion they’d occasionally run out and then things would go a bit wobbly.  These days they sit at 800MB – 900MB free constantly (that’s on a 2GB RAM Pi).

 

Hope that’s some help,

 

Luke

 

From: <> On Behalf Of Michael Tiernan
Sent: 23 October 2020 15:24
To:
Subject: [perfsonar-user] Fwd: Re: Fwd: CI Engineering Brown Bag - Friday July 24th @ 2pm ET

 

A followup sort of question for those on the list.

 

On 7/23/20 12:52 PM, Jason Zurawski wrote:

 

This talk will focus on the experiences at University of Michigan installing and testing perfSONAR on non-traditional hardware platforms such as network hardware (routers) and Single Board Computers such as the Raspberry Pi.  We will also talk about the new perfSONAR S3 storage plugin and perfSONAR plugin development methodologies.

Has anyone worked on a SBC (Raspberry Pi is my current interest) "Target" for some of this testing?

I know there's a CPU muscle issue for doing all the heavy lifting PS would impose on a system so I wonder if anyone's thought of creating a simplified target that can respond to tests from a more powerful host?

Implementation example might be to facilitate "Work from home" operations where the "Company" could test links out to employee's endpoints for reliability and a modest standard of speed test. (As well as availability.)

Plant a simple SBC unit at the target's home and let it respond to test requests from a primary server.
(Yes, I know that this goes against the primary design goal of PS of "De-centralized" operations but it seems like a reasonable offshoot.)

It might even be able to do lightweight testing back against the single host but that would just be a plus in the overall design.

Thanks for your time.

 
-- 
 << MCT >> Michael C Tiernan
 +1 (617) 324-9173 |  Slack: https://Bates-HPRCF.slack.com
 MIT-Research Computing Project - http://researchcomputing.mit.edu/
 High Perf Research Computing Facility at The Bates Linear Accelerator



Archive powered by MHonArc 2.6.19.

Top of Page