Search:  

 
 
   All ForumsHot TopicsGallery






how-to block ads


 
Forums » Tech and Talk » Computing Clubs » Distributed Computing » [FP] For Jim...
Search Topic:
Uniqs:
786
Share Topic:
RSS topic:
toggle:
flat / full
normal / watch
Posting:
Post a:
Post a:
« [FP] cURL Updates....  
page: 1 · 2 · 3
AuthorAll Replies


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas

[FP] For Jim...

Took a stab at the stats.bat tonight, but there are limitations to what you can do with a .bat file in Windows.

I did manage to get done what you needed, but not without a glitch.

The output I get looked like this.

quote:
---------- C:\GPU\FAH5.91BETA4-GPU\UNITINFO.TXT
Current Work Unit
-----------------
Name: 1258 GPUlambda
Download time: March 5 07:37:44
Due time: March 11 07:37:44
Progress: 30% [|||_______]

---------- C:\GPU\FAH5.91BETA4-GPU\CLIENT.CFG
username=TH_Foldinator

---------- C:\GPU\FAH5.91BETA4-GPU\CLIENT.CFG
team=4
As you can see, it removed the Tag: - line, and I even got it to manually check the clinet.cfg file, and add those two lines. Although, it is not the Fahusername:, Fahteamid: format currently used by the Foldy stats scripts. That would be a minor edit, but would have to be done both in the foldy stats script, and Starfish See Profile's python uploader app. as well(for those using it).

But, it also adds the other three lines that you see. Which is defeating the purpose. I can't find a way for it not to add those lines, with the command Windows uses to add the lines needed.

So, basically, we are back to finding another way to do it. A linux script would be easiest, but not cross platform. PHP,Perl, or Python would be easy, and cross platform. But would require one to install extra software to be able to use them.

As you are working with Windows, I will see what I can come up with, as I have the time. Perhaps a VB, or WSH script that will do the job.


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
Thanks

One of our ubber-smart programmers at work laughed at me.
(I asked if he had an easy way to do it.)

I might find something - I appreciate your help


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
·VOIPo
·WOW Internet and C..
·Broadvox Direct

reply to MstrBlstr
This link looks too good to be true.

»www.kilowattsoftware.com/PoofSummary.htm

Wondering a bout the install method

"Before you download AuroraWare!™ and Poof!™ product ZIP files you must perform a pre-installation step."


2 Pre-installation

1. You may need to be logged on as an administrator to perform product pre-installation.
2. You must be connected to the internet before pre-installation can proceed.
3. During product pre-installation you may be surprised when some windows appear and disappear automatically. This is normal behavior for the pre-installation process.
4. When the pre-installation process completes successfully a readme.txt file is displayed with the Notepad accessory. Please save this file to your hard drive for future reference.
5. Click the following link to begin
=== product pre-installation ===

--
Jim -- USA2K
SEE: REBEKAH
VoIP since 12/2002, Packet8 since 12/2006. Vonage as backup.


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas

Let me look into it a bit... It sounds a bit werid, to say the least. I have tools that will track what is actually being done to the computer. If I trash this OS, it is not a big thing, I can just format and re-install.


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
Thanks - also I would only test things on the personal PC.
ESPECIALLY something odd.


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
·VOIPo
·WOW Internet and C..
·Broadvox Direct


1 edit
 Hmmmm »unxutils.sourceforge.net/

Looks more promising :)



Directory of C:\scripts\UnxUtils\usr\local\wbin

[.] [..] agrep.exe ansi2knr.exe
basename.exe bc.exe bison.exe bunzip2.exe
bzip2.exe bzip2recover.exe cat.exe chgrp.exe
chmod.exe chown.exe cksum.exe cmp.exe
comm.exe compress.exe cp.exe csplit.exe
cut.exe date.exe dc.exe dd.exe
df.exe diff.exe diff3.exe dircolors.exe
dirname.exe du.exe echo.exe egrep.exe
env.exe expand.exe expr.exe factor.exe
fgrep.exe find.exe flex.exe fmt.exe
fold.exe fsplit.exe gawk.exe gclip.exe
gplay.exe grep.exe gsar.exe gunzip.exe
gzip.exe head.exe id.exe indent.exe
install.exe join.exe jwhois.exe less.exe
lesskey.exe libfl.a libfl.lib ln.exe
logname.exe ls.exe m4.exe make.exe
makedepend.exe makemsg.exe man.exe md5sum.exe
mkdir.exe mkfifo.exe mknod.exe mv.exe
mvdir.exe nl.exe od.exe paste.exe
patch.exe pathchk.exe pclip.exe pr.exe
printenv.exe printf.exe pwd.exe recode.exe
rm.exe rman.exe rmdir.exe sdiff.exe
sed.exe seq.exe shar.exe sleep.exe
sort.exe split.exe stego.exe su.exe
sum.exe sync.exe tac.exe tail.exe
tar.exe tee.exe test.exe touch.exe
tr.exe type.exe uname.exe unexpand.exe
uniq.exe unrar.exe unshar.exe unzip.exe
uudecode.exe uuencode.exe wc.exe wget.exe
wget.hlp which.exe whoami.exe xargs.exe
yes.exe zcat.exe zip.exe
121 File(s) 5,982,028 bytes


bbarrera
Premium,MVM
join:2000-10-23
Sacramento, CA
clubs:
·SureWest Internet


1 edit
Hey folks, just install copSSH on Windows and you get an easy-to-install SSH Server plus the necessary Unix utilities:

~> ls /bin
UserActivationWizard.exe cygminires.dll less.exe sftponly
UserDeactivationWizard.exe cygncurses-8.dll ln.exe sort.exe
bash.exe cygpath.exe ls.exe ssh-add.exe
cat.exe cygpcre-0.dll mkdir.exe ssh-agent.exe
chgrp.exe cygpcre.dll mkgroup.exe ssh-keygen.exe
chmod.exe cygreadline6.dll mkpasswd.exe ssh-keyscan.exe
chown.exe cygrunsrv.exe mv.exe ssh-keysign.exe
copsshadm.exe cygwin1.dll ps.exe ssh.exe
cp.exe cygz.dll pwd.exe sshd.exe
cygcheck.exe date.exe rebase-copssh.cmd tail.exe
cygcrypt-0.dll diff.exe rebase.exe tar.exe
cygcrypto-0.9.8.dll false.exe rm.exe touch.exe
cygiconv-2.dll grep.exe scp.exe wc.exe
cygintl-1.dll groups sed.exe
cygintl-2.dll gzip.exe sftp-server.exe
cygintl-3.dll id.exe sftp.exe

Given the tools bundled with copSSH I'd start by looking at using grep and/or sed in a bash shell script.


PinHead
Premium
join:2002-06-19
The Dungeon
clubs:

reply to MstrBlstr
It looks like your trying to have a windows machine upload foldy stats to the stats server. If so, here is my *.bat file that I used.

fstat.bat
copy t:\blade1\FAH4\task_1\unitinfo.txt+id.txt 1-1-unitinfo.txt
copy t:\blade2\FAH4\task_1\unitinfo.txt+id.txt 1-2-unitinfo.txt
copy t:\blade3\FAH4\task_1\unitinfo.txt+id.txt 1-3-unitinfo.txt
C:\winnt\system32\ftp -s:fstat.txt

id.txt
Fahusername: TH_Foldinator
Fahteamid: 4

fstat.txt
open ftp.powweb.com
--insert username--
--insert password--
put 1-1-unitinfo.txt 1-1-unitinfo.txt
put 1-2-unitinfo.txt 1-2-unitinfo.txt
put 1-3-unitinfo.txt 1-3-unitinfo.txt
quit

It copies the unitinfo.txt file from a windows map drive of a linux ( or any box ) to a directory where I set the other files and appends the contents of id.txt ( because the blades always ran under TH_Foldinator ) to a new file name 1-1-unitinfo.txt ( for the stats server engine ). It then calls windows ftp with the fstat.txt that holds the ftp commands. It's a chain, but when setup; all I had to do was set fstat.bat as a scheduled event in windows. This is how I reported and monitored Foldy1's linux diskless/headless blades and reported it's stats to foldy.nozero.org.

Anyone can use at will if it proves useful.

--
time nor tide wait for no man...


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas

The problem is that there is an extra line in the GPU clients unitinfo.txt file that we are trying to remove. When the "Tag:-" line is left in the unitinfo.txt file, it screws things up in the Foldy stats engine.

Take a look at at blade F2-02(I think), and you will see what I am talking about.

On another note.

DO NOT do the pre-install for the poof stuff. I will not go into details, JUST DON"T DO IT!


PinHead
Premium
join:2002-06-19
The Dungeon
clubs:
You should be able to modify the php code on the server to test for the Tag: and skip that line.
--
time nor tide wait for no man...


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas
Yeah, I probably could. But that is not likely going to ever happen.


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas

reply to usa2k
It's late, but I found some time to play before going to bed for the night. So, I thought that I would post an update.

In the following, you will see that everything was done in a Windows command line dos shell.


Windows DOS Shell


2-02-unitinfo.txt 149 bytes
Resulting file


And the resulting file is also attached.

I did it in several steps, to show what all was going on. You can see the commands that I used. The second to the last, being the one that output the 2-02-unitinfo.txt file that would be uploaded to the foldinator stats site.

I need to play a bit more with it, and get it to pull the username and team # fields from the client.cfg file. It would be a simple matter to manually place them in the file, but that defeats the purpose of checking to make sure that those fields are always configured correctly.

As I stated before, I can pull them from the client.cfg file with no problem. But, they are not the same format as what the foldy stats engine looks for. So, that would need to be changed, as I previously stated above. Or, I will have to try and see if I can check for those lines, and truncate them to the correct format.

It's not that I don't trust Jim, or any of the other ops. But, it would be nice to have the checking feature in place, as was in Starfish See Profile's upload app.

I am not sure that it is worth the effort, but if the membership thinks it is a good idea, I will see what I can do.


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
·VOIPo
·WOW Internet and C..
·Broadvox Direct


2 edits
reply to usa2k
said by usa2k See Profile :

Hmmmm »unxutils.sourceforge.net/

Looks more promising :)
That gave me a working "sed" command and I hand twea  ked the results as follows:

copy C:\GPU\FAH5.91beta4-GPU\unitinfo.txt c:\stats\gpu-unitinfo.txt

echo append club details

echo Fahusername: TH_Foldinator >> C:\stats\gpu-unitinfo.txt

echo Fahteamid: 4 >> gpu-unitinfo.txt

c:\stats\wbin\cat c:\stats\gpu-unitinfo.txt | \stats\wbin\sed
-e /Tag/d;s/Protein/p2737_GPUlambda/ > 2-02-unitinfo.txt

curl -v -m 5 -T 2-02-unitinfo.txt -u user:pass »ftp://ftp.site.com/
The file was:
Current Work Unit
-----------------
Name: Protein
Tag: -
Download time: March 7 12:06:52
Due time: March 13 12:06:52
Progress: 71% [|||||||___]

And now becomes:
Current Work Unit
-----------------
Name: p2737_GPUlambda
Download time: March 7 12:06:52
Due time: March 13 12:06:52
Progress: 71% [|||||||___]
Fahusername: TH_Foldinator
Fahteamid: 4

Resulting in:




No matter what WU is offered, it currently does not properly identify the WU so far. I swapped "Protein" for "p2737_GPUlambda" so the seemingly popular name is there. If it changes, at least the percent complete field is looking correct now.

Those instructions were made part of the stats batch file to upload every 20 minutes. :)
--
Jim -- USA2K
SEE: REBEKAH
VoIP since 12/2002, Packet8 since 12/2006. Vonage as backup.


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas
Nice Jim. Looks to be basically what I was working on.

Until they get their naming conventions for the protein names a little more consistent, it will be hard to keep those fields populated.


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
·VOIPo
·WOW Internet and C..
·Broadvox Direct


1 edit
  Now its showing a different WU so the substitute did not happen.

It says "1258 GPUlambda" which I recall was a bad number reference before, so no score. Maybe later I will add the rule for that text ...

Everything else is staying aligned!
--
Jim -- USA2K
SEE: REBEKAH
VoIP since 12/2002, Packet8 since 12/2006. Vonage as backup.


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas

reply to MstrBlstr

But still something for Jim.

The Sapphire X1950 Pro AGP Guide

Installs, Troubles, Diagnosis


Starfish
Per Ardua Ad Astra
ExMod 2002-04
join:2000-12-28
Netherlands
clubs:

reply to PinHead

I don't have the code of the original PHP script on the server at hand but, if I recall correctly, it does iterate over all the lines of data it receives in such a way that a small modification to skip the "Tag:" line should probably the easiest option as PinHead See Profile already suggests. Also because it's the 'central stats processor', it removes the need to adjust N blades.


usa2k
Please PRAY for Rebekah
Premium,MVM
join:2003-01-26
Canton, MI
clubs:
·VOIPo
·WOW Internet and C..
·Broadvox Direct


1 edit
  You, Pinhead, and MstrBlstr, likely know tons more about PHP than I may ever know. (I seemed to take to perl more easily.)

There was discussion about making a GPL release, but we kinda ran out of steam. The trouble there is you would likely get feedback overload and keeping up would be the trouble.

Until the GPU comes out of beta, we likely should expect incomplete information.

The protein being called "Protein" instead of "p2737_GPUlambda"
Or called "1258 GPUlambda" instead of "p2734_GPUlambda"
that tells me its a losing battle for a while.
Better to fix my own local anomaly than code it into the website.
--
Jim -- USA2K
SEE: REBEKAH
VoIP since 12/2002, Packet8 since 12/2006. Vonage as backup.


Starfish
Per Ardua Ad Astra
ExMod 2002-04
join:2000-12-28
Netherlands
clubs:


1 edit
said by usa2k See Profile :

Better to fix my own local anomaly than code it into the website.
Well.. the amount of code to that has to be changed may be as little as one line, depending on if I correctly remember it's structure.

That sounds like less trouble than finding local work arounds.



edit for clarity: that is, the extra line thing, not the fix for protein names (and more?)


MstrBlstr
Status - Tired
Premium
join:2005-03-15
South Texas


3 edits
reply to usa2k
said by usa2k See Profile :

Until the GPU comes out of beta, we likely should expect incomplete information.

The protein being called "Protein" instead of "p2737_GPUlambda"
Or called "14?? GPUlambda" instead of "p2734_GPUlambda"
that tells me its a losing battle for a while.
Better to fix my own local anomaly than code it into the website.
Agreed, on that part.

However, the "Tag: -" issue should be eaisily fixable in the stats engine itself. And as Fishy said, then it would not be required to be fixed in all the uploader app/script versions.

Of course, for now, you are the only OP with a GPU client that is required to do this. And you have already done so.

Edit -- Fishy faster than me..

Edit 2 -- IIRC, the "TAG: -" line is also in the unitinfo.txt for the SMP clients as well. I could be mistaken though.

Starfish, you don't have a copy of hte script, or just not a current version of the one on the foldy.nozero.org?

If the latter, couldn't Jim just send you a copy?
Forums » Tech and Talk » Computing Clubs » Distributed Computing« [FP] cURL Updates....  
page: 1 · 2 · 3


Sunday, 06-Dec 00:28:29 Terms of Use | Privacy Policy | Hosting by www.nac.net - DSL,Hosting & Co-lo | feedback | contact
over 10 years online! © 1999-2009 dslreports.com.
page compression OFF
Most commented news this week
· [163] Comcast Releasing Promised Usage Meter
· [147] Avast Antivirus Has Gone Mad
· [128] Comcast Makes NBC Universal Acquisition Official
· [122] The Bandwidth Hog Does Not Exist
· [105] Graduate Student Unveils Sprint's GPS Sharing With Feds
· [101] Google Invades ISP, OpenDNS Turf With Google Public DNS
· [85] FCC Ponders Moving From PSTN To IP Voice
· [82] Latest Consumer Reports Survey Not Kind To AT&T
· [80] New Bill Aims To Limit ETFs
· [75] Sprint Defuses GPS Privacy Media Bomb
Most people now reading
· False positive in Avast! or is it real? [Security]
· Windows 7 boot manager editing questions [Microsoft Help]
· 3.x Feral Druid - Bear Tanking Guide [World of Warcraft]
· [How to] Install Asterisk on an Asus WL-520GU router [VOIP Tech Chat]
· Wife might have to work in.... Iowa for a few months!!! [General Questions]
· Connecting to Google Voice Via SIP [VOIP Tech Chat]
· What is the spell hit cap for a lvl 80 full arcane spec mage [World of Warcraft]
· First commercial tool to crack BitLocker arrives (Updated) [Security]
· [Rant] Disrespect of PTO [Rants, Raves, and Praise]
· [Newsgroups] Newzleech down? [Filesharing Software]