perfSONAR User Q&A and Other Discussion

[Aaron Brown <>]

Hey Takatoshi,

Excellent, glad I was able to fix the issue :)

Cheers,
Aaron

On Jun 19, 2014, at 3:08 AM, Takatoshi Ikeda 
<>
 wrote:

> Dear Aaron-san,
> 
> I appreciate your great work.
> I confirm new BWCTL 1.5.2-6 works fine!!
> 
> 
> $ bwctl -V
> Version: 1.5.2-6
> 
> $ bwctl -c XXXXXXXX -u
> bwctl: Using tool: iperf
> bwctl: 16 seconds until test results available
> 
> RECEIVER START
> bwctl: start_endpoint: 3612150229.201609
> bwctl: run_endpoint: receiver: XXXXXXXXXXXXXX
> bwctl: run_endpoint: sender: YYYYYYYYYYYYY
> bwctl: exec_line: iperf -B XXXXXXXXXXX -s -f b -m -p 5295 -u -t 10
> bwctl: run_tool: tester: iperf
> bwctl: run_tool: receiver: XXXXXXXXXXX
> bwctl: run_tool: sender: YYYYYYYYYYYYY
> bwctl: start_tool: 3612150232.631415
> ------------------------------------------------------------
> Server listening on UDP port 5295
> Binding to local address XXXXXXXXXXXXXX
> Receiving 1470 byte datagrams
> UDP buffer size: 124928 Byte (default)
> ------------------------------------------------------------
> [  8] local XXXXX port 5295 connected with YYYYYYYY port 5295
> [ ID] Interval       Transfer     Bandwidth        Jitter   Lost/Total 
> Datagrams
> [  8]  0.0-10.0 sec  1252440 Bytes  1000009 bits/sec   0.002 ms    0/  852 
> (0%)
> bwctl: stop_tool: 3612150247.138371
> bwctl: stop_endpoint: 3612150247.138639
> 
> 
> Thank you,
> -Takatoshi Ikeda
> 
> On Wed, 18 Jun 2014 18:17:17 +0000
> Aaron Brown 
> <>
>  wrote:
> 
>> Hey Takatoshi,
>> 
>> I was able to reproduce and figured out what was happening. I’ve updated 
>> the bwctl version in the repository to 1.5.2-6 which should fix this 
>> issue. Let me know if you have any problems with it.
>> 
>> Cheers,
>> Aaron
>> 
>> On Jun 18, 2014, at 6:11 AM, Takatoshi Ikeda 
>> <>
>>  wrote:
>> 
>>> Dear Aaron-san,
>>> 
>>> This is the result.
>>> I did downgrade to avoid this issue but I've upgraded again for 
>>> the test. Still, I have same issue.
>>> 
>>> 
>>> *Receiver
>>> # /etc/init.d/iptables stop
>>> iptables: Setting chains to policy ACCEPT: filter          [  OK  ]
>>> iptables: Flushing firewall rules:                         [  OK  ]
>>> iptables: Unloading modules:                               [  OK  ]
>>> 
>>> # bwctl -V
>>> Version: 1.5.2-5
>>> 
>>> 
>>> *Sender
>>> # /etc/init.d/iptables stop
>>> iptables: Setting chains to policy ACCEPT: filter          [  OK  ]
>>> iptables: Flushing firewall rules:                         [  OK  ]
>>> iptables: Unloading modules:                               [  OK  ]
>>> 
>>> # bwctl -V
>>> Version: 1.5.2-5
>>> 
>>> # bwctl -c perf-sin -u -x
>>> bwctl: Using tool: iperf
>>> bwctl: 15 seconds until test results available
>>> 
>>> RECEIVER START
>>> bwctl: Remote 'client' (Sender) never initiated handshake: listening at
>>> port(6015) - canceling
>>> 
>>> RECEIVER END
>>> 
>>> SENDER START
>>> 
>>> SENDER END
>>> 
>>> 
>>> Best Regards,
>>> -Takatoshi Ikeda
>>> 
>>> 
>>> 
>>> On Tue, 17 Jun 2014 12:55:20 +0000
>>> Aaron Brown 
>>> <>
>>>  wrote:
>>> 
>>>> Hi Takatoshi,
>>>> 
>>>> That’s strange, given the error being seen. Could you run the bwctl 
>>>> command with the “-x” flag, and send the results? That should show both 
>>>> the send and receive side test messages.
>>>> 
>>>> Cheers,
>>>> Aaron
>>>> 
>>>> On Jun 16, 2014, at 9:09 PM, Takatoshi Ikeda 
>>>> <>
>>>>  wrote:
>>>> 
>>>>> Aaron-san,
>>>>> 
>>>>> It's only UDP iperf test. 
>>>>> I do scheduled test with TCP but it works fine.
>>>>> 
>>>>> Regards,
>>>>> -Takatoshi Ikeda
>>>>> 
>>>>> On Mon, 16 Jun 2014 13:17:12 +0000
>>>>> Aaron Brown 
>>>>> <>
>>>>>  wrote:
>>>>> 
>>>>>> Hi Takatoshi,
>>>>>> 
>>>>>> Is it only the UDP iperf that’s failing, or do other tests fail as 
>>>>>> well?
>>>>>> 
>>>>>> Cheers,
>>>>>> Aaron
>>>>>> 
>>>>>> On Jun 14, 2014, at 10:21 AM, Takatoshi Ikeda 
>>>>>> <>
>>>>>>  wrote:
>>>>>> 
>>>>>>> Dear Aaron,
>>>>>>> 
>>>>>>> Yes. I didn't modify the port for the iperf test.
>>>>>>> In addition, I did that test without iptables. 
>>>>>>> ( turn off it by "service iptables stop" )
>>>>>>> 
>>>>>>> regards,
>>>>>>> -Takatoshi Ikeda
>>>>>>> 
>>>>>>> 
>>>>>>> On Fri, 13 Jun 2014 14:37:24 +0000
>>>>>>> Aaron Brown 
>>>>>>> <>
>>>>>>>  wrote:
>>>>>>> 
>>>>>>>> Hi Takatoshi,
>>>>>>>> 
>>>>>>>> The error message that’s being seen is a common firewall error. Are 
>>>>>>>> they both using the same bwctld.conf?
>>>>>>>> 
>>>>>>>> Cheers,
>>>>>>>> Aaron
>>>>>>>> 
>>>>>>>> On Jun 13, 2014, at 2:36 AM, Takatoshi Ikeda 
>>>>>>>> <>
>>>>>>>>  wrote:
>>>>>>>> 
>>>>>>>>> Hello, 
>>>>>>>>> 
>>>>>>>>> After I upgrade the all the packages on our pSPT 3.3 system by yum.
>>>>>>>>> BWCTL test with UDP becomes failure.
>>>>>>>>> When I downgrade only BWCTL package to 1.5.1-20, it works again.
>>>>>>>>> 
>>>>>>>>> Followings are the detail information.
>>>>>>>>> Do you have any idea?
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> -OS
>>>>>>>>>> uname -a
>>>>>>>>> Linux perf-sin.tein-jp.net 2.6.32-431.17.1.el6.aufs.web100.x86_64 
>>>>>>>>> #1 SMP Thu May 8 13:20:43 PDT 2014 x86_64 x86_64 x86_64 GNU/Linux
>>>>>>>>> 
>>>>>>>>> -BWCTL
>>>>>>>>>> rpm -qa|grep bwctl
>>>>>>>>> bwctl-client-1.5.2-5.el6.x86_64
>>>>>>>>> bwctl-server-1.5.2-5.el6.x86_64
>>>>>>>>> 
>>>>>>>>> -BWCTL test with UDP
>>>>>>>>>> bwctl -c XXXXXXX -u
>>>>>>>>> bwctl: Using tool: iperf
>>>>>>>>> bwctl: 16 seconds until test results available
>>>>>>>>> 
>>>>>>>>> RECEIVER START
>>>>>>>>> bwctl: start_endpoint: 3611628623.920596
>>>>>>>>> bwctl: run_endpoint: receiver: XXXXXXXXXXX
>>>>>>>>> bwctl: run_endpoint: sender: XXXXXXXXXXXX
>>>>>>>>> bwctl: Remote 'client' (XXXXXXXXXXXXXX) never initiated 
>>>>>>>>> handshake:listening at port(6116) - canceling
>>>>>>>>> bwctl: stop_endpoint: 3611628629.310156
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> -Receiver log
>>>>>>>>> Jun 13 14:20:55 perf-sin bwctld[48187]: FILE=sapi.c, LINE=353, 
>>>>>>>>> Connection to
>>>>>>>>> (YYYYYYYYYYYYYYYY:4823) from (XXXXXXXXXXXXXX:54479)
>>>>>>>>> Jun 13 14:20:55 perf-sin bwctld[48187]: FILE=sapi.c, LINE=510,
>>>>>>>>> ControlSession([YYYYYYYYYYYY]:4823) accepted from
>>>>>>>>> userid(nil):(XXXXXXXXXXXXXX:54479)
>>>>>>>>> Jun 13 14:20:55 perf-sin bwctld[26647]: FILE=bwctld.c, LINE=791, 
>>>>>>>>> Test Reservation Information: Current Time: 1402636855, Fuzz: 
>>>>>>>>> 1.976562, Reservation Start: 1402636858, Reservation End: 
>>>>>>>>> 1402636873, Test Start Time: 1402636860
>>>>>>>>> Jun 13 14:20:55 perf-sin bwctld[26647]: FILE=bwctld.c, LINE=442, 
>>>>>>>>> Reservation Status: time=1402636855 action=new 
>>>>>>>>> sender=XXXXXXXXXXXXXX receiver=YYYYYYYYYYYY tool=iperf 
>>>>>>>>> res_start=1402636858 res_end=1402636872 test_start=1402636860
>>>>>>>>> Jun 13 14:20:55 perf-sin bwctld[26647]: FILE=bwctld.c, LINE=822, 
>>>>>>>>> Time Slots
>>>>>>>>> Jun 13 14:20:55 perf-sin bwctld[26647]: FILE=bwctld.c, LINE=827, 
>>>>>>>>> Time Slot 1: 1402636858 to 1402636873: 1 reservations
>>>>>>>>> Jun 13 14:21:00 perf-sin bwctld[48188]: FILE=endpoint.c, LINE=864, 
>>>>>>>>> Endpoint peer connection could not accept(): listening at 
>>>>>>>>> port(6052) : Interrupted system call
>>>>>>>>> Jun 13 14:21:00 perf-sin bwctld[48188]: FILE=endpoint.c, LINE=873, 
>>>>>>>>> Endpoint: Signal = 14
>>>>>>>>> Jun 13 14:21:00 perf-sin bwctld[26647]: FILE=bwctld.c, LINE=442, 
>>>>>>>>> Reservation Status: time=1402636860 action=remove 
>>>>>>>>> sender=XXXXXXXXXXXXXX receiver=YYYYYYYYYYYY tool=iperf 
>>>>>>>>> res_start=1402636858 res_end=1402636872 test_start=1402636860
>>>>>>>>> 
>>>>>>>>> -Sender log
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[56212]: FILE=sapi.c, LINE=353, 
>>>>>>>>> Connection to (XXXXXXXXXXXXXX:4823) from (YYYYYYYYYYYY:34829)
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[56212]: FILE=sapi.c, LINE=510, 
>>>>>>>>> ControlSession(XXXXXXXXXXXXXX:4823) accepted from 
>>>>>>>>> userid(nil):(YYYYYYYYYYYY:34829)
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctl: Using tool: iperf
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[29146]: FILE=bwctld.c, LINE=791, 
>>>>>>>>> Test Reservation Information: Current Time: 1402636855, Fuzz: 
>>>>>>>>> 2.046875, Reservation Start: 1402636858, Reservation End: 
>>>>>>>>> 1402636873, Test Start Time: 1402636860
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[29146]: FILE=bwctld.c, LINE=442, 
>>>>>>>>> Reservation Status: time=1402636855 action=new 
>>>>>>>>> sender=XXXXXXXXXXXXXX receiver=YYYYYYYYYYYY tool=iperf 
>>>>>>>>> res_start=1402636858 res_end=1402636872 test_start=1402636860
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[29146]: FILE=bwctld.c, LINE=822, 
>>>>>>>>> Time Slots
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[29146]: FILE=bwctld.c, LINE=827, 
>>>>>>>>> Time Slot 1: 1402636858 to 1402636873: 1 reservations
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctl: 16 seconds until test results 
>>>>>>>>> available
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[56212]: FILE=endpoint.c, 
>>>>>>>>> LINE=1455, _BWLEndpointStatus: Child #56213 exited from signal #11
>>>>>>>>> Jun 13 14:20:55 perf-kote kernel: bwctld[56213]: segfault at 0 ip 
>>>>>>>>> (null) sp 00007ffffb82cbd8 error 14 in bwctld 
>>>>>>>>> (deleted)[400000+40000]
>>>>>>>>> Jun 13 14:20:55 perf-kote bwctld[29146]: FILE=bwctld.c, LINE=442, 
>>>>>>>>> Reservation Status: time=1402636855 action=remove 
>>>>>>>>> sender=XXXXXXXXXXXXXX receiver=YYYYYYYYYYYY tool=iperf 
>>>>>>>>> res_start=1402636858 res_end=1402636872 test_start=1402636860
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> -- 
>>>>>>>>> Takatoshi Ikeda 
>>>>>>>>> <>
>>>>>>>>> 
>>>>>>> 
>>>>>>> -- 
>>>>>>> Takatoshi Ikeda 
>>>>>>> <>
>>>>>>> 
>>>>> 
>>>>> -- 
>>>>> Takatoshi Ikeda 
>>>>> <>
>>>>> 
>>> 
>>> -- 
>>> Takatoshi Ikeda 
>>> <>
>>> 
> 
> -- 
> Takatoshi Ikeda 
> <>
>