PDA

View Full Version : llrnetserver (*nix or Windows)



IronBits
02-24-2008, 10:41 PM
./llrnet llrserver.lua in *nix is the same as running llrserver.exe in windows.
sample llr-serverconfig.txt for FULL Server (not a PROXY)

Change stuff in BOLD

-------------------
-- general settings
-------------------

-- server name
-- used in particular to identify the server into the sql stats table
-- (change this name if you have several servers using the same sql database)
serverName = "llrnet.no-ip.info"

-- port that the server listen to (make sure clients are configured
-- with the same number)
port = 300

-- maximum number of concurrent connections
maxConnections = 300

-- maximum allowed time for a user to complete a job (in seconds)
jobMaxTime = 4 * 24 * 3600 -- 4 days

-- various files used by the server
knPairsFile = "knpairs.txt"
jobListFile = "joblist.txt"
resultsFile = "results.txt"

-- if you want the server to regularly prune your knpairs and joblist
-- files, then uncomment the following line and set the period of
-- pruning in second.
prunePeriod = 0.5 * 24 * 3600 -- 1/2 days

-- (for gurus only)
if WIN32 then
no_shell = 1
end

-- format used to display numbers in result file
-- (uncomment the appropriate line)
--displayFormat = "%s*2^%s+1" -- use this for PRP type test
displayFormat = "%s*2^%s-1" -- use this for LLR type test (default)

-- uncomment the following line to remove username check when
-- accepting a new result
noUserCheck = 1

-- you can customize the way the date is displayed
-- (in joblist.txt and results.txt)
--function DisplayDate()
-- return date("%d/%m/%Y\ %r")
--end

-----------------
-- PROXY settings
-----------------
-- uncomment the following line to make this server a proxy server
--proxy = 1

-- address of the parent server
proxyMasterAddress = "localhost"
proxyMasterPort = 7000

-- name of this proxy (change 'nobody' to something else)
proxyName = "nobody"

-- size of the proxy cache
--proxyCacheSize = 100

-- minimum number of results to send back to the main server
-- at a time
--proxyTosendThreshold = 25

-- name of the tosend file of the proxy
tosendFile = "tosend-proxy.txt"


-----------------
-- User CALLBACKS
-----------------

-- below is an example of callback to log all primes as they are
-- found into an additional file

--function OnPrime(t, k, n, job)
-- local fileprime = openfile("primes.txt", "a")
-- if fileprime then
-- write(fileprime, format("[%s]\n", job.resultdate))
-- write(fileprime, format(displayFormat.." is prime! Time : %d.0 sec.\n",
-- k, n,
-- Seconds() - job.seconds))
-- closefile(fileprime)
-- end
--end


-- similarly, you can have another callback called OnResult,
-- beware that it takes one additional argument (the residue)

--function OnResult(t, k, n, residue, job)
-- insert whatever you want here
--end


------------------------------------------
-- SQL settings (mySql only at the moment)
------------------------------------------

-- uncomment the line below to use SQL
--sqlUsed = 1

-- sql general configuration
sqlServer = "localhost"
--sqlServerPort = 4000
sqlDriver = "mysql"
sqlUser = "llrnet"
sqlPassword = "llrnet"
sqlDbName = "llrnet"

-----------------
-- SQL user table
-----------------
-- uncomment the line below and set the name of the table of users
--sqlUsersTable = "users"

-- name of the fields containing the username and the password
sqlUsernameEntry= "username"
sqlPasswordEntry= "password"


------------------------
-- SQL pairs and results
------------------------
-- uncomment the line below and set the name of the tables
--sqlPairsTable = "pairs"
sqlJobsTable = "jobs"
sqlResultsTable = "results"
sqlRejectedTable= "rejected"


------------
-- SQL stats
------------
-- uncomment the line below to allow llrnet server statistics and infos
-- to be regularly updated into the given sql table
--sqlStatsTable = "stats"


--------------------------
-- WIN32 specific settings
--------------------------
-- uncomment the line below to hide the tray icon on startup
--hideTrayIcon = 1

-- change this value if you want to run several client as services
serviceName = "NPLB_LLRserver300"

-- under WIN32 platform, uncomment the following line to log stdout and stderr
-- to a file called "stdout.txt"
--logOutput = 1

IronBits
02-24-2008, 10:43 PM
sample llr-serverconfig.txt for personal Proxy
Change stuff in BOLD

-------------------
-- general settings
-------------------

-- server name
-- used in particular to identify the server into the sql stats table
-- (change this name if you have several servers using the same sql database)
serverName = "Free-DC_IronBits"

-- port that the server listen to (make sure clients are configured
-- with the same number)
port = 100

-- maximum number of concurrent connections
maxConnections = 15

-- maximum allowed time for a user to complete a job (in seconds)
jobMaxTime = 14 * 24 * 3600 -- 14 days

-- various files used by the server
knPairsFile = "knpairs.txt"
jobListFile = "joblist.txt"
resultsFile = "results.txt"

-- if you want the server to regularly prune your knpairs and joblist
-- files, then uncomment the following line and set the period of
-- pruning in second.
prunePeriod = 1 * 24 * 3600 -- every days

-- (for gurus only)
if WIN32 then
no_shell = 1
end

-- format used to display numbers in result file
-- (uncomment the appropriate line)
--displayFormat = "%s*2^%s+1" -- use this for PRP type test
--displayFormat = "%s*2^%s-1" -- use this for LLR type test (default)

-- uncomment the following line to remove username check when
-- accepting a new result
noUserCheck = 1

-- you can customize the way the date is displayed
-- (in joblist.txt and results.txt)
--function DisplayDate()
-- return date("%d/%m/%Y\ %r")
--end

-----------------
-- PROXY settings
-----------------
-- uncomment the following line to make this server a proxy server
proxy = 1

-- address of the parent server
proxyMasterAddress = "CRUS.dynip.telepac.pt"
proxyMasterPort = 100

-- name of this proxy (change 'nobody' to something else)
proxyName = "Free-DC_IronBits"

-- size of the proxy cache
proxyCacheSize = 200

-- minimum number of results to send back to the main server
-- at a time
proxyTosendThreshold = 25

-- name of the tosend file of the proxy
tosendFile = "tosend-proxy.txt"


-----------------
-- User CALLBACKS
-----------------

-- below is an example of callback to log all primes as they are
-- found into an additional file

--function OnPrime(t, k, n, job)
-- local fileprime = openfile("primes.txt", "a")
-- if fileprime then
-- write(fileprime, format("[%s]\n", job.resultdate))
-- write(fileprime, format(displayFormat.." is prime! Time : %d.0 sec.\n",
-- k, n,
-- Seconds() - job.seconds))
-- closefile(fileprime)
-- end
--end


-- similarly, you can have another callback called OnResult,
-- beware that it takes one additional argument (the residue)

--function OnResult(t, k, n, residue, job)
-- insert whatever you want here
--end


------------------------------------------
-- SQL settings (mySql only at the moment)
------------------------------------------

-- uncomment the line below to use SQL
--sqlUsed = 1

-- sql general configuration
sqlServer = "localhost"
--sqlServerPort = 4000
sqlDriver = "mysql"
sqlUser = "llrnet"
sqlPassword = "llrnet"
sqlDbName = "llrnet"

-----------------
-- SQL user table
-----------------
-- uncomment the line below and set the name of the table of users
--sqlUsersTable = "users"

-- name of the fields containing the username and the password
sqlUsernameEntry= "username"
sqlPasswordEntry= "password"


------------------------
-- SQL pairs and results
------------------------
-- uncomment the line below and set the name of the tables
--sqlPairsTable = "pairs"
sqlJobsTable = "jobs"
sqlResultsTable = "results"
sqlRejectedTable= "rejected"


------------
-- SQL stats
------------
-- uncomment the line below to allow llrnet server statistics and infos
-- to be regularly updated into the given sql table
--sqlStatsTable = "stats"


--------------------------
-- WIN32 specific settings
--------------------------
-- uncomment the line below to hide the tray icon on startup
--hideTrayIcon = 1

-- change this value if you want to run several client as services
serviceName = "NPLB_LLRserver"

-- under WIN32 platform, uncomment the following line to log stdout and stderr
-- to a file called "stdout.txt"
--logOutput = 1

Beyond
02-24-2008, 10:46 PM
You do not need the proxy cache size or to send threshold on the full server.

IronBits
02-25-2008, 12:18 AM
Good to know. How about proxyName?

-- name of this proxy (change 'nobody' to something else)
proxyName = "nobody"

And do we really need to use MySql and what would it's purpose be?

Beyond
02-25-2008, 06:46 AM
You do not need proxy name when running the full server.

You do not need MySQL, it's primary purpose is for generating stats and it makes it is track down rogue machines/users submitting faulty results.

IronBits
02-25-2008, 10:31 AM
Ah, maybe I'll stick MySQL and Apache on the Server and have DP help me set it up so I can do stats to ;)

BTW, go easy, just testing, have limited knpairs and Carlos and kar_bon are sucking on what Carlos said his quad could chew up in 18 hours. :)

I'm trying to get a lot more work now to handle your insatiable hounds :)

llrnet.no-ip.info is the Server
port = 500

Beyond
02-25-2008, 11:50 AM
I'm almost completely shutdown as far as NPLB goes. I have no more than 10 cores hitting Carlos' Server right now (five of them from work).

From my llrnet proxy logs, router logs and direct observations the problem was two fold. First, Carlos's proxy could not keep up with the demand for connections and his pruning process which removes completed tests from the knpairs and joblist files was getting overwhelmed.

* I had an almost constant connection from the home farm when his proxy was up. But everytime his proxy was up my proxy was flooding his with results (2000/hour). I tryed shutting off access to his server to allow others to connect for a while, but that just increased the load on his proxy once I allow connections again. (At one point I had over 5000 results waiting for upload) And caused his proxy to shutdown quicker.


Second, my own proxy was getting overwhelmed with connections once I got above about 40 cores, by the time I got 60 cores it would completely lock up.

* I tryed setting up a second proxy to run from Carlos' port 300 proxy, but it locked it up too, so turned it off. As a side note, once I reached 60 cores the traffic bogged down my own network, I could not reach my webserver or dnet proxy and websurfing slowed to a crawl.


I really like the project so will be trying something different to get going again, I think moving the proxies over to the Linux boxes will be first step and perhaps setting up 2 seperate subnets instead of everything running off one. Problem is getting the time to do all of this. :(

em99010pepe
02-25-2008, 04:53 PM
IronBits,

Please check your email address or read this.

Stop the server and add the following numbers at the end of the knpairs.txt file. Edit your server config file txt and change the pruning to each hour.

http://celppinho.googlepages.com/NPLB-3168-3200.zip

IronBits
02-25-2008, 06:06 PM
Done, back running again. Thanks! :cheers:

em99010pepe
02-25-2008, 06:07 PM
Beyond,

I increased to 1000 connections per second on Win XP, now port 100 can handle 500 connections per second. Do you want to try and move a few cores to it?

IronBits
02-25-2008, 06:07 PM
Beyond, try 5 quads worth and leave it at that ;)

em99010pepe
02-25-2008, 06:08 PM
Beyond, try 5 quads worth and leave it at that ;)
And put a few more on IronBits's server...lol

Beyond
02-25-2008, 07:25 PM
Beyond,

I increased to 1000 connections per second on Win XP, now port 100 can handle 500 connections per second. Do you want to try and move a few cores to it?

I should have at least five already on it from work, started last Friday evening. But I will add a few more a little later tonight.


Beyond, try 5 quads worth and leave it at that

That leaves 4 quads plus the 1 AMD Quad I have yet to put together. :)
The scramble to connect this weekend did not leave time for the fun stuff. :(


And put a few more on IronBits's server...lol

Just what I was thinking! :thumbs:

IronBits
02-25-2008, 07:52 PM
Just what I was thinking! :thumbs:
Bring it, don't sing it. :jester:

llrnet.no-ip.info
port = 500
:hifi:

Beyond
02-26-2008, 07:49 AM
50 cores now ..... 10,000+ tests so far, and without as much as a single hiccup.:cheers:

Beyond
02-27-2008, 07:41 AM
I was able to get 56 cores on IB's proxy before it crashed. :)

To be fair, my proxy locked up during communicating which probably caused the crash. :bang:

Reduced cores by 1/2 for the day, if it crashes now not much I can do till this evening. I am going to try to run out all the cached tests this evening (a few clients at a time) then shut it down. As it stands I'm having far too many network problems and causing too much trouble for those running the servers.

IronBits
02-27-2008, 08:14 AM
Well, why don't you just leave 20 cores on it and put the rest on another project.
I think Carlos says we have about 2 weeks to go to finish up.

Helix_Von_Smelix
03-20-2008, 06:43 PM
does this run on windows 2003 SBS server??:cheers:

IronBits
03-20-2008, 07:30 PM
Both client and server and proxy server work find under Windows xxx