Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] perfSONAR and Grafana

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] perfSONAR and Grafana


Chronological Thread 
    < Chronological >      < Thread >
  • From: Mark Feit <>
  • To: Jarett DeAngelis <>, Danial Ebling <>
  • Cc: "" <>
  • Subject: Re: [perfsonar-user] perfSONAR and Grafana
  • Date: Tue, 3 Jan 2023 17:15:45 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=internet2.edu; dmarc=pass action=none header.from=internet2.edu; dkim=pass header.d=internet2.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=3HqSoeN+zX47hQqzjGX1tTIoo5mVMz02ednZcjOph3I=; b=AztLMl/m3Gb8kxKq3W3qLv+Nq9n/OgD2qNwoTF6yCGfg79hn6T9yh98FCak4ehnQjrmHIDKCjpB7SdN1Jd8MpDRwGSkcszErAQPEHJEG6tNBOQgMjn3CPDtKZF1d6x4kpREi0GbuqC6u8hR8PzVUKGtGznWD575IxWIZL47Jgy/IdVYz3Lt04wgH3+fXrrS2d7LkwszSboKavZ9u4dwD7uRm5MCWTSM0ErN4rDjkC6rGib9+RaDuJKl8IFxreVu+W6eeAFFOhsInOdLo5j4LtyCWTpGB3Up6L2brSillxLidgXnKx8cVfhw4crE6+7a5RJ8yLPd3M/HEu/xs7WPcvQ==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kCXanDwO5EKFFqdB7S7De2LOfOvJfGkdHS9RTG1nzFrMTOscW9/iFvpeastg//xYIiDJ+AOLPeKzgBEg01Exev3OnAyOetybQYFJC0aYREHFRp8WjGXrkdE2eX7M5BsVmSpdxR8CdpV5JNgPjXEDM+sFmWZ6EZwaBlGhMUdahyCj9/AYoxsp8neYN8Yu+GMnFW3HKhpVTtbf9EuBI3mL7dRwAe0ecAf5t4PeEUwkDGyjzCTwM8xg5W8bORkktJnZTG3YrSFBL62Z9KJNH4m6VKLjtwDypcHUjEkSiGhYAJ4qBL0j1QQsx3ChDs0Uk3G6iYQafewlimdwiTEBB9fmZQ==

Jarett DeAngelis writes:

 

can you say a bit more about how you set this up? I think I may be missing a middle step here. I thought I could use the Infinity data source plugin in Grafana, but I think that's not right, it's not able to listen to things posting to a URL.

 

I’m not familiar with the Infinity plugin, but a quick look at the docs hints that it’s really a many-common-formats-to-Grafana translator.   For using Infinity, the missing middle step is having a store for the data to live that can be queried.

 

RMQ and Kafaka are useful if you already have infrastructure in place for getting the information to whatever systems are going to hold and query it.  For example, WLCG has its own storage and display systems because they gather more than just perfSONAR data.  RMQ is its entry point.  They used to have a program that would query Esmond for new perfSONAR measurements and dump them into RMQ.  Now they have archivers in their meshes that archive directly to a RMQ topic that understands pScheduler’s test results.   (I’m not sure they’re fully migrated, but that’s where they’re headed.)

 

If you’re just starting out, I’d recommend posting to Elastic via HTTP and, optionally, LogStash.  We’ll be shipping something similar with 5.0.

 

--Mark

 


Archive powered by MHonArc 2.6.24.

Top of Page