Yet Another Modem Statistics tool in TekSavvy

Yet Another Modem Statistics tool in TekSavvy http://www.dslreports.com/forum/r21499303 en Sat, 05 Dec 2009 19:57:54 EDT Sat, 05 Dec 2009 19:57:54 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22588166 Bicephale : Hi,

Sorry but TerTech only lurks around occasionally as
he "retired" (so he wrote himself)... 'DSL_StatScope'
was created specifically for Thomson's SpeedTouch
5x6 series because the other 3rd-party applications
encountered some FirmWare limitations, as i recall.

You might be able to evaluate TerTech's utility with
this proxy in between if you happen to own a 2Wire:

»proxy2wire progress (2wire to DMT proxy)
»proxy2wire beta released!

The source-code for v1.0 is available to an eventual
developper who would intend to adapt this software
to other brands/models, perhaps with some luck one
will be lucky to get the latest v1.2 from TerTech the
next time he passes by...]]> http://www.dslreports.com/forum/remark,22588166 Sun, 21 Jun 2009 19:05:35 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22587609 murdoc2k : does this software work with other modems (eg:TP-LINK TD-8816)?]]> http://www.dslreports.com/forum/remark,22587609 Sun, 21 Jun 2009 16:24:18 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22587554 Bicephale : Hi SpeedTouch owners,

This is to remind us all that 'DSL_StatScope v1.2'
was released a while ago, it's available right here:

'DSL_StatScope v1.2'

Also, lets point out one of it's most useful feature
is its capacity to load ("Play-Back") a log-file so it
implies that one can post his record as a .ZIP file
for others to scrutinize dynamically, avoiding the
difficulties due to graphic capturing & encoding...

Put briefly, we can rescale and zoom onto details
not captured by a graphic sample!

]]> http://www.dslreports.com/forum/remark,22587554 Sun, 21 Jun 2009 16:07:17 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22272900 Bicephale : Hummm...

The more i look at them the more similitudes i recognize and
one puzzles me a bit: what's going on from 15h15 to 17h?!...

]]> http://www.dslreports.com/forum/remark,22272900 Tue, 21 Apr 2009 14:15:48 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22272708 Bicephale : Hi TerTech,

It may take a while until you see this but i though it would
be better to post my findings to your attention. The result
isn't what i was expecting but i must confess i've played a
lot with your numbers... In any case, i'd wish to bring your
attention on the date stamp of March 26 3:00:19 (3:01:29)
and that of March 27 23:00:29 (23:01:39): you'll recognize
a pattern in the date/time bug i've found, i presume...

Among the few things i've done, i tried to reject the effect
of disconnections on the SNR Margin curves in order to get
a better idea of what these are like... Clipping has been my
favourite trick for some time now so it was applied here too
as an attempt to ignore "sparkles" which would contaminate
the curves with single events otherwise. Last but not least,
i used a logarithmic function in some creative way and was
so pleased with this i finally included that element for you to
consider as a potential addition in case of future upgrades:
it allowed me to fit low and high value patterns together on
a very same graphic (there were so much more FEC errors
than the CRC/HEC ones i just couldn't use the same scale).

Looking at the graphic i notice your line was relatively OKay
between 1h30 - 4h00, 10h00 - 15h00 and 22h00 - 23h30...

Experimental Analysis of TerTech's Log (2009-Mar, 26-28)
Experimental···28) .ZIP 250,668 bytes

]]> http://www.dslreports.com/forum/remark,22272708 Tue, 21 Apr 2009 13:41:59 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22260012 Bicephale : Hi TerTech,

I'm so glad you've paid us a visit, it's even more rejoycing
to find that you're releasing 'DSL_StatScope v1.2' today!

Thanks for lurking around, have a good evening/night sir!

]]> http://www.dslreports.com/forum/remark,22260012 Sat, 18 Apr 2009 22:59:47 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22259897 anon : I found a bug in DSL_Statscope. If the ST516 uses firmware 6.1.0.5, the program will indicate that every sample contains a modem disconnect. If you turn on "Show disconnects" it will create a whole graph full of them.

I found this out because I'm back to using 6.1.0.5 firmware in order to tweak my modem connection. I'm getting disconnects every few minutes unless I set the SNRM to MAX. This lowers the speed to 1 MBps then I only get 2 or 3 disconnects a day.

In case anybody besides bicephale is using this tool, here's the fixed version.

DSL_StatScope.zip 1,357,556 bytes

]]> http://www.dslreports.com/forum/remark,22259897 Sat, 18 Apr 2009 22:24:02 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22215269 Bicephale : King of the road! ...and its display is quite adjustable:

Click Here to zoom in! (Evening problems, Anon_Tertech, 2009-Apr-10)

TerTech's "Nocturnal Disruptions" of March 25 (.CSV Log-File, 1281177 Bytes)

Decadent luxury!...

]]> http://www.dslreports.com/forum/remark,22215269 Fri, 10 Apr 2009 11:54:40 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22214186 Angelo_ : nice tool]]> http://www.dslreports.com/forum/remark,22214186 Fri, 10 Apr 2009 06:45:49 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,22214134 Bicephale : TerTech, over here!

Click here to zoom in!

]]> http://www.dslreports.com/forum/remark,22214134 Fri, 10 Apr 2009 05:47:50 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21918018 anon :

said by Bicephale

:

Hi TerTech,

I hope you'll be around, this one calls for you:

»Trying to troubleshoot DL SNRM

Feel free to jump in; I'm retired :^)

Tertech.]]> http://www.dslreports.com/forum/remark,21918018 Sat, 14 Feb 2009 20:38:41 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21917552 Bicephale : Hi TerTech,

I hope you'll be around, this one calls for you:

»Trying to troubleshoot DL SNRM

]]> http://www.dslreports.com/forum/remark,21917552 Sat, 14 Feb 2009 19:02:48 EDT TOP! http://www.dslreports.com/forum/remark,21705145 Bicephale : Judging from a few recent posts this thread needs to resurface towards the top!

...amd why not also read a bit of this:

»From the ground up!

]]> http://www.dslreports.com/forum/remark,21705145 Thu, 08 Jan 2009 17:50:34 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21632328 Bicephale : Hi TerTech,

I have a suggestion to make relatively to eventual
future revisions of 'DSL_StatScope'. Lets suppose
the average CRC rate is roughly predictible already:

In this example, the final count was an evaluation
resulting from the "filtered" numbers making up the
area under the curve instead of the whole record.

If the curve's amplitude amounts to a certain value
during the normal periods then it's suitable to limit
burts after reaching some threhold. Perhaps if you
could add a feature that chops the upper part of
extreme bursts (aberrations) this would help to get
well focused curves which will easily become blurred
because the dots are being scattered otherwise...

;)]]> http://www.dslreports.com/forum/remark,21632328 Wed, 24 Dec 2008 14:19:40 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21579677 Bicephale : Now, captures of 'DSL_StatScope' itself.

Miniature included for future reference...

;)

The original .CSV data is available here:

From the ground up!, Bicephale, 2008-Dec-14

VelCom - 'DSS v1.0' & ST516v6 FW v6.2.29.2-GE (Large)
VelCom - 'DSS v1.0' & ST516v6 FW v6.2.29.2-GE (Small)

]]> http://www.dslreports.com/forum/remark,21579677 Sun, 14 Dec 2008 10:51:24 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21578238 Bicephale : Great HiVolt! Otherwise i would have refered you to this post:

»Re: Yet Another Modem Statistics tool

:)

I'd bet you do have 'DMT v9.01' working in "Diagnosis" mode...]]> http://www.dslreports.com/forum/remark,21578238 Sat, 13 Dec 2008 22:14:52 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21578222 HiVolt : Its no big deal anyway, my line is solid. I dont really need to monitor line stats all the time.
--
GO LEAFS GO!]]> http://www.dslreports.com/forum/remark,21578222 Sat, 13 Dec 2008 22:11:39 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21578162 Bicephale : Euh...

I mean, could this just be a simple coïncidence?

From the ground up!, Bicephale, 2008-12-7

:p]]> http://www.dslreports.com/forum/remark,21578162 Sat, 13 Dec 2008 21:58:53 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21578135 Bicephale : Hi HiVolt,

Well, it's too soon for me to draw conclusions
but maybe you're better off with the Siemens:

From the ground up!, Bicephale, 2008-Dec-13

;)]]> http://www.dslreports.com/forum/remark,21578135 Sat, 13 Dec 2008 21:52:57 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21578126 HiVolt : Cool utility, too bad its only for the ST... Mine is dead, using a SpeedStream at the moment...
--
GO LEAFS GO!]]> http://www.dslreports.com/forum/remark,21578126 Sat, 13 Dec 2008 21:49:39 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21578114 Bicephale : Hi TerTech,

This wouldn't have been possible without your
help, i wish to thank you warmly and publicly!

From the ground up!, Bicephale, 2008-Dec-13

:D]]> http://www.dslreports.com/forum/remark,21578114 Sat, 13 Dec 2008 21:46:42 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21504189 tertech :

said by RobinK

:

Nice tool, tertech. I like it and the graphs it can produce.

But I think you should make three separate graphs or at least give the option to view SNR, rates and errors in separate graphs. Having one graph with different vertical limits for each variable is unconventional and makes it harder to read.

If not, same type data like (rates, SNR, errors) should have same vertical limits by default. Might want to consider new default colours that are easier to follow too. Would also be nice to change the background colour. :)

Also, what does increment do?

Thanks for your input. You are one of the fortunate ones for whom error rates are somewhat constant. I created this utility because my stats were all over the place. In one single sample I could have 10's of CRC errors and 100's of FEC errors. By making separate scaling factors, I can spread the values vertically on the graph rather than just have an off-scale straight line across the top or bottom.

It happens frequently on weekday mornings at ~07:00 that I get an FEC storm. This results in a lowering of SNRM. To see them on the same graph makes the relationship of the one to the other more obvious. Generally I turn off all the uplink values, and only enable the downlink SNRM and error stats. When I see a situation that caused the modem to disconnect & re-sync, I back up in time and view each error type with a scaling that makes the values spread vertically.

The 'increment' selection box chooses the value to change the upper and lower limit values when the up/down arrow beside each value is pressed. In my case for spreading the error values across the vertical it's easier to just press the up-arrow and have the value increase by 10 or 100 and see the graph react to each incremental change.

The colours are a bit of a nuisance; I can't make up my mind what I like the best; it's subjective to each individual's preference. One thing I'm thinking of doing is to save the user's graphical preferences in an 'ini' file or the system registry. At least you wouldn't have to make the same adjustments every time you start the program.]]> http://www.dslreports.com/forum/remark,21504189 Sun, 30 Nov 2008 11:59:22 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21502987 Bicephale : Oups! TerTech, i just realized these negative
values don't exist yet in the log files: they're
the result of calculations done later instead...

Sorry to bother!

:p]]> http://www.dslreports.com/forum/remark,21502987 Sat, 29 Nov 2008 23:57:53 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21502959 RobinK : Nice tool, tertech. I like it and the graphs it can produce.

But I think you should make three separate graphs or at least give the option to view SNR, rates and errors in separate graphs. Having one graph with different vertical limits for each variable is unconventional and makes it harder to read.

If not, same type data like (rates, SNR, errors) should have same vertical limits by default. Might want to consider new default colours that are easier to follow too. Would also be nice to change the background colour. :)

Also, what does increment do?
--
Argue opinions using facts. Not facts using opinions.

SNR, rates, errors have same vertical limit

]]> http://www.dslreports.com/forum/remark,21502959 Sat, 29 Nov 2008 23:50:21 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21502868 Bicephale : Hi again,

About aberrations, finally it's simpler for
me just to post an illustration right here.

This graphic was generated using 'GNUmeric'
to process a log file generated by 'DMT' run
in "Diagnosis" mode. The negative values are
resulting from a disconnection (zero SNR), it
is meaningless information but those numbers
are so large everything else will vanish into
the baseline if it's not corrected manually...

:p

DMT Diagnosis Aberrations

said by Bicephale

:

Oh, i almost forgot...

One question about reading aberrations: 'DMT'
in "Diagnosis" mode often generates very large
numbers during transitions which would totally
offset a curve's range. I've been working with
'GNUmeric' SpreadSheets lately and my solution
to that problem was to "clip" those events to a
negligible negative fraction if negative or what
appears to be the curve's normal peek, my goal
being to conserve as much details as possible.

I'm wondering how you dealt with that relatively
to the log files (the display itself already has two
customisable fields for the upper/lower limits).

:)

I'm not sure what situation you're referring to. IM me with details please.]]> http://www.dslreports.com/forum/remark,21502291 Sat, 29 Nov 2008 20:39:59 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21502256 tertech :

said by Bicephale

:

Hi TerTech,

•The CRC dots being critical they should have
   priority over the HEC and FEC dots (in this
   order) which are presently masking it. See my
   animated .GIF from above. This was captured
   using the [Load] option (playback) after the
   log file was copied to my everyday machine.

O.K makes sense. I usually just enable one error stat at a time because it is too crowded to see everything.

•When trying to play back a tiny log file with
   only a few time-slice records nothing happened
   and there was no error message to explain why
   but maybe i was supposed to restart 'DSS' 1st;
   i even thought it was about 8.3 DOS filenames.

The intent was that either you were doing a Telnet capture or playing back a file. I prevent a file being loaded when a Telnet session is active; I thought I made it allow a file load after a Telnet session was stopped. It looks like it doesn't allow a file load if a Telnet session had been run, even if it was stopped. You will have to restart the program to load a file if you had a Telnet session.

•You can make the window's width two characters
   less using "DS" (DownStream) instead of "D/L"
   (DownLoad) and "US" (UpStream) instead of "U/L"
   (UpLoad).filenames.

It's UpLink and DownLink ( I'm a satellite guy ). You're right though about giving more room to the U/L SNRM and D/L SNRM labels.

•This should have been called v1.25 or something:
some persons won't even try it when it's a first
release. I say the loss is theirs, though!

It's the first release. If I counted every version that I didn't release it would be like v25. The first number is a major release and will increment with new features or some incompatibility with previous releases. The second number is a minor release with just cosmetic changes that is still compatible with previous versions of the same major release number. For example if the log file format changed that would need a new major release number.

•Perhaps i didn't find it but there should be a hidden
"easter egg" with Santa's face in it somewhere!...

Keep looking. ;)]]> http://www.dslreports.com/forum/remark,21502256 Sat, 29 Nov 2008 20:31:36 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21502074 Bicephale : Oh, i almost forgot...

One question about reading aberrations: 'DMT'
in "Diagnosis" mode often generates very large
numbers during transitions which would totally
offset a curve's range. I've been working with
'GNUmeric' SpreadSheets lately and my solution
to that problem was to "clip" those events to a
negligible negative fraction if negative or what
appears to be the curve's normal peek, my goal
being to conserve as much details as possible.

I'm wondering how you dealt with that relatively
to the log files (the display itself already has two
customisable fields for the upper/lower limits).

:)]]> http://www.dslreports.com/forum/remark,21502074 Sat, 29 Nov 2008 19:42:12 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21502023 Bicephale : Hi TerTech,

My test only starts at midnight so i can still
play around with 'DSL_StatScope v1.0' a bit,
after that i'll leave it alone doing it's job.

:)

Here are my preliminary observations, something
may very well have slept through... Well, you've
brought the SpeedTouch owners a unique piece
of work and i can only think of cosmetic aspects.

•The CRC dots being critical they should have
   priority over the HEC and FEC dots (in this
   order) which are presently masking it. See my
   animated .GIF from above. This was captured
   using the [Load] option (playback) after the
   log file was copied to my everyday machine.

•When trying to play back a tiny log file with
   only a few time-slice records nothing happened
   and there was no error message to explain why
   but maybe i was supposed to restart 'DSS' 1st;
   i even thought it was about 8.3 DOS filenames.

•You can make the window's width two characters
   less using "DS" (DownStream) instead of "D/L"
   (DownLoad) and "US" (UpStream) instead of "U/L"
   (UpLoad).

•This should have been called v1.25 or something:
   some persons won't even try it when it's a first
   release. I say the loss is theirs, though!

•Perhaps i didn't find it but there should be a hidden
   "easter egg" with Santa's face in it somewhere!...

In any case, thank you for this precious opportunity!

:D

Note:

I was hungry late last night so i started cooking
something to eat (the CRC burst did confirm it).

Now, imagine if i conducted such a test with help
from the powerful averaging feature for a week!

;)

DSL_StatScope v1.0 - CRC vs HEC & FEC
]]> http://www.dslreports.com/forum/remark,21502023 Sat, 29 Nov 2008 19:27:25 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21500283 tertech :
said by Bicephale :

Hi TerTech,

Excellent! I've put my ST516v6 (FW v6.2.29.2)
on-line just a few minutes ago and it happens
i needed an alternative to the "Diagnosis" item
of 'DMT' (which is a greyed out option if using
this FirmWare). I wished to compare my MoDems
for a very long time, now i'm sure Santa exists!

:o

My plan is to start an evaluation by collecting a
high-resolution (15 sec.) long-term sample under
"Linear" mode and with the "Follow current time"
feature enabled (i presume the later option has
to do with time-slice round-up synchronisation).

I can't wait to see the curve averaging function
in action since it's specific to 'DSL_StatScope'
and no other 3rd-party tool did that until now
but i'm patient and these tests take time. You
can bet i'll be back to share my observations, it
brings us to mid-December or so but i'll be there!

:D

Ho Ho Ho Merry Christmas :D Well, I hope you can put this program to good use. I did a lot of testing myself, but I am interested to hear any problems you may encounter with your long term captures. It's only version 1.0, so I don't expect it to be perfect.

Just to clarify... the "follow current time" option simply automatically scrolls the graphical display so that the most recent capture is always visible, that's all.

Enjoy :D :D ]]> http://www.dslreports.com/forum/remark,21500283 Sat, 29 Nov 2008 10:36:31 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21499816 Bicephale :

Addendum:

I'm so impressed looking at this very unique utility
showing evidence of the "Cooking Hour Syndrome"
in real time i've now made it a channel on my TV!

;)]]> http://www.dslreports.com/forum/remark,21499816 Sat, 29 Nov 2008 04:17:36 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21499678 Bicephale : Hi TerTech,

Excellent! I've put my ST516v6 (FW v6.2.29.2)
on-line just a few minutes ago and it happens
i needed an alternative to the "Diagnosis" item
of 'DMT' (which is a greyed out option if using
this FirmWare). I wished to compare my MoDems
for a very long time, now i'm sure Santa exists!

:o

My plan is to start an evaluation by collecting a
high-resolution (15 sec.) long-term sample under
"Linear" mode and with the "Follow current time"
feature enabled (i presume the later option has
to do with time-slice round-up synchronisation).

I can't wait to see the curve averaging function
in action since it's specific to 'DSL_StatScope'
and no other 3rd-party tool did that until now
but i'm patient and these tests take time. You
can bet i'll be back to share my observations, it
brings us to mid-December or so but i'll be there!

:D]]> http://www.dslreports.com/forum/remark,21499678 Sat, 29 Nov 2008 02:27:58 EDT Re: Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21499358 CanerisErik : Great work! I look forward to playing with it when we get more 516s next week.]]> http://www.dslreports.com/forum/remark,21499358 Fri, 28 Nov 2008 23:45:15 EDT Yet Another Modem Statistics tool http://www.dslreports.com/forum/remark,21499303 tertech : for the ST516.

I recently started a thread to discuss the bizarre behaviour of my ST516 modem. As the discussion progressed, I was convinced that I would need to do some long-term analysis of my modem's connection metrics, especially the error rates.

»ST516 - Strange discovery

The popular DMT tool has a diagnostic option to output a comma-separated-variable (CSV) file containing all the modem metrics. This can be fed into several programs such as MS-Excel or Matlab to create summary reports and graphs. The only problem is that the DMT diagnostic feature is only supported on some versions of the ST516 firmware. Once I upgraded to newer firmware loads, I had no way to capture the detailed results to evaluate the new firmware's performance. Out of necessity I created my own simple program to just grab the data from the ST516 and store it in a .CSV format similar to that created by DMT. After that, I got a little carried away and added some real-time graphing capabilities to the program. I call the program DSL_StatScope. I was tempted to call it 'YAMS' but then you would think me an old UNIX hack :uhh:

It has been suggested to me that other Teksavvy customers with highly attenuated, noise infested DSL connections might make good use of this program to measure the effect of new firmware, or upgraded wiring, or whatever. So here it is; just unzip the file into a directory and you'll find a readme.txt file. It's pretty simple to use.
DSL_StatScope.zip 1,357,567 bytes
]]> http://www.dslreports.com/forum/remark,21499303 Fri, 28 Nov 2008 23:24:39 EDT