Download

Documentation

Community

Development

Timeline


and .

07/20/09:

15:56 cluster/modules edited by peter
(diff)
15:55 cluster/modules edited by peter
(diff)
15:45 cluster/modules edited by peter
(diff)
14:58 cluster/modules edited by peter
(diff)
14:12 cluster/modules edited by peter
(diff)
13:57 cluster/modules created by peter
13:55 documentation edited by peter
(diff)
04:17 Changeset [24964cf8a92367a6cf6d250aa6a38644cab878ea] by Peter Krenesky <peter@…>
Moving master and all of its plugins that don't fit elsewhere into …
04:06 Changeset [c2bcf4d01e498f1e0be390d634c937ee7590dd54] by Peter Krenesky <peter@…>
removing a print statement
04:04 Changeset [43f4080ebb6a89cd4f84644d022553ca233d1806] by Peter Krenesky <peter@…>
removing commented code that was moved elsewhere with the module system
04:01 Changeset [5a4e506a914d984fcbf15ad91206315a34b973af] by Peter Krenesky <peter@…>
Modulizing - Finishing WorkerAvatar? implementation WorkerAvatar? acts as a …

07/19/09:

23:45 Changeset [7a49eb06d6373b9c8a76874c691e1603d62c1af1] by Peter Krenesky <peter@…>
ModuleManagers? should emit 'MANAGER_INIT' rather than a class specific …
23:44 Changeset [efbf67ce5029edc03395b8b6516232adacdd1131] by Peter Krenesky <peter@…>
Worker now inherits WorkerManager? so that it can intialize TaskManager?
23:42 Changeset [49f63007300134383b886f739233b63b2b3b38c0] by Peter Krenesky <peter@…>
ModuleManager? now does not require modules to be passed into init, if they …
23:22 Changeset [875979ecaeae8a40a27f9aafb0efab64586a4c6b] by Peter Krenesky <peter@…>
WorkerConnectionManager? now uses _workers instead of workers
23:22 Changeset [50476ec5796cbd6da21d73b38ebee11ad338ea27] by Peter Krenesky <peter@…>
AMFInterface now outputs full stacktrace on errors
17:03 git edited by peter
(diff)
05:59 Changeset [07de65b4edb8a8e2b3ee56a3caf39e847a772292] by Peter Krenesky <peter@…>
Modulizing - Workers can now connect and authenticate with the Master …
05:30 Changeset [a19827e844733d1945f8396ef2e519be6744c3ae] by Peter Krenesky <peter@…>
Modulizing - Tasks can now be queued again: * merged run_tasks from …
04:43 Changeset [93b53069c5a64a477c2913156b86015765a18d9e] by Peter Krenesky <peter@…>
TaskStatus? now works again. * TaskScheduler? now shares _workers and …
04:36 Changeset [f962dabcbfcf39ae2b38a32c2fcf38840a6ba42b] by Peter Krenesky <peter@…>
Node status now works again * NodeManager? was not receiving all the …
04:19 Changeset [b1478e7ea7aa71037120d6f55c5ecaa01786bb17] by Peter Krenesky <peter@…>
Merge branch 'master' into modulizing: pulling in the latest changes so …
04:00 Changeset [b0c3095ab7be08d0230e39c17627faef8da19d46] by Peter Krenesky <peter@…>
Task History now works
03:57 Changeset [14a480d8fd51e7db3aea1ac30e8269360566c555] by Peter Krenesky <peter@…>
Few minor fixes for the last commit for controllerinterface: * node …
03:25 Changeset [43e48cca725e23fc137518110f7436e1df37b51a] by Peter Krenesky <peter@…>
Modulizing Commit: Finished implementation for InterfaceModule? and …

07/18/09:

07:45 git edited by peter
(diff)
07:39 Changeset [85a7874830f3a2907282aea020d0c48095109f97] by Peter Krenesky <peter@…>
More work on Modularization: ControllerInterface? focus * …
05:01 Changeset [3c1f2c88981b7c44cda232cba4a004f30238561f] by Peter Krenesky <peter@…>
Modularization work: Master now properly connects with Workers and Nodes. …

07/16/09:

15:40 Changeset [d23385da4bebb8a53971c54756be78d708ab212f] by Peter Krenesky <peter@…>
Error in task now cause an exception to be written to the node.log (from …
13:33 Ticket #86 (Formatting Error with logger) closed by peter
fixed: This was a bug in worker.py. It was a line attempting to send multiple …
13:32 Changeset [a7feca60a2cf16b15cbabc82e51986e183f712bd] by Peter Krenesky <peter@…>
ticket #86 Formatting Error with logger
13:24 Changeset [3c7bd60c212080a0af45c08a66badb4befe6a61f] by Peter Krenesky <peter@…>
Worker now only creates a new instance of a Task if it is a different …
13:20 Changeset [8ee00db9442744a96a197cc01dcc3fbc51409198] by Peter Krenesky <peter@…>
Task Manager can now take a comma delimited list of directories for the …

07/15/09:

14:50 Changeset [0b6bae5c837000eb35cd04f9f3e4ff206f7479ad] by Peter Krenesky <peter@…>
TaskContainer?._start_subtask() was not passing args to the subtask
14:49 Changeset [875bf4faac5fee1219b9396b2c7e2418cb96c8f4] by Peter Krenesky <peter@…>
finished workunits that can't be returned because task is stopped are now …

07/14/09:

19:55 Changeset [69ce15fef512e0ca06e26c7b21ebfc942b5f0f32] by Peter Krenesky <peter@…>
Making Task.work() and all its descendent classes asynchronous to solve …

07/13/09:

20:05 Changeset [5ef353e920693c6453da261996bfc3628c262928] by Peter Krenesky <peter@…>
moving jquery include to before the 'head' block
19:57 Changeset [2483a49c50591b76f087e73dceefc1ae81ce814a] by Peter Krenesky <peter@…>
Merge branch 'master' of  ssh://trac.osuosl.org/var/lib/git/pydra
19:53 Changeset [0dd1e53a0db5507d092a78e22fcc14c1f6607d1c] by Peter Krenesky <peter@…>
Improvements to ParallelTask? base class: * combined _assign_work(...) …
04:12 Changeset [38cefe3b88822f8d3d60ed5cc7cc8999c332d887] by Peter Krenesky <peter@…>
Checking in work in progress for ticket #107 - refactor into components …

07/12/09:

21:49 Changeset [4d8cdca8381fcb1b70ed9112743ef42be3e7733a] by Peter Krenesky <peter@…>
fixing logging duplicates
16:13 Changeset [165fc23769b36ebf79db37c943d8498fa00e2691] by Peter Krenesky <peter@…>
Work toward Ticket #107 - Refactor cluster functionality into components …
06:17 Changeset [1567af47990fd22c3429570161648da3c1423be1] by Peter Krenesky <peter@…>
More work towards modules: Master and all modules initialize. Though …
03:55 Changeset [e68ca4a45070e23b8072dc78efd36e7252ba39f4] by Peter Krenesky <peter@…>
Checking in work progress for Modulization of Master

07/11/09:

22:20 Changeset [ee82e57d18f91af680cba91470cf8a068b3b255c] by Peter Krenesky <peter@…>
master now uses port settings stored in pydraSettings
21:09 Ticket #101 (Tasks that fail to import properly are still reported as loading) closed by peter
fixed: Now fixed. Syntax exceptions, and other excpetionts, that prevent a class …
21:05 Changeset [0a75145957aaec70300914934acbd8b288877c4e] by Peter Krenesky <peter@…>
Task manager now catches exceptions while importing tasks
06:51 security edited by peter
(diff)
06:49 security edited by peter
(diff)
06:47 security edited by peter
(diff)
06:47 security edited by peter
(diff)
06:30 Ticket #102 (jquery should be included in base.html) closed by peter
fixed
06:29 Changeset [8454699b09604ee951997e1c8285676166b6fc37] by Peter Krenesky <peter@…>
Ticket #102 - jquery should be included in based.html
06:26 Ticket #105 (Manually created nodes do not connect until restart) closed by peter
fixed
06:25 Ticket #111 (css and help for node edit page) created by peter
node edit page has no css for the form itself. The form should be styled …
06:22 Ticket #110 (Nodes View - If worker initializes for the first time while viewing the ...) created by peter
If you are viewing the Nodes page the first time a Node is initialized it …
06:15 Changeset [0ace6acf75b88d4ed48dfd82254ee41d85fdb015] by Peter Krenesky <peter@…>
Ticket #105 - Manually created nodes do not connect until restart
06:14 Changeset [aae281479bd8cddf161c7143e6c75baa9f6390f7] by Peter Krenesky <peter@…>
Nodes View - submenu items were only being displayed when there were nodes
06:03 Changeset [b65f19dafb27efb022b83ce0543d770bcc5d156b] by Peter Krenesky <peter@…>
Views for nodes.html now interact with cluster through the AMFInterface. …
05:57 Changeset [8f69c679473256b2a9ebf07da8a87ac9c67d1bf4] by Peter Krenesky <peter@…>
Adding some more file extensions to .gitignore
03:40 Ticket #108 (trivial changes) closed by peter
fixed
03:40 Ticket #109 (Tasks meant to be subtasks only should have a flag to prevent them from ...) created by peter
Any task found in the tasks directory will be added as a task. The …
03:16 Changeset [dff9a4e30b787e3bbfaf3cf48f8c191a08ee8fe9] by Peter Krenesky <peter@…>
Ticket #108 - Trivial Changes: - make manage.py executable for …

07/10/09:

22:42 Ticket #108 (trivial changes) created by redduck666
here is a set of trivial changes: - make manage.py executable for …
19:10 Changeset [550358dec59556a15427c01009a4d827fd61a3aa] by Peter Krenesky <peter@…>
Adding some missing functions to worker_proxy
16:39 Changeset [fb1b82d42b82454a9572d711e7b561853a4e0e39] by Peter Krenesky <peter@…>
Merge branch 'master' of  ssh://trac.osuosl.org/var/lib/git/pydra
16:36 Changeset [ede6e1d62b9bd2af190d97a17615990910b06715] by Peter Krenesky <peter@…>
Even more fixes caused by splitting tasks into their own files: * …
16:33 Changeset [edf35a20019324f64499c076453b1f21758b558f] by Peter Krenesky <peter@…>
Task manager now uses pydraSettings.tasks_dir to determine where task …
15:16 Ticket #107 (Refactor cluster functionality into components) created by peter
The complexity of the master and node classes has been increasing making …
15:05 Ticket #106 (Implement Datasources / Slicing API) created by peter
For ParallelTasks?, MapReduceTasks?, etc to run properly the flow of data in …
14:57 Changeset [8f1c7ca54324c33bc3b7cdb7e2374512bb078105] by Peter Krenesky <peter@…>
Ticket #99 start scripts missing shebang - courtesy of Almir Karic …
14:57 Ticket #99 ([patch] shebang) closed by peter
fixed: wierd, they worked for me.
14:53 Ticket #105 (Manually created nodes do not connect until restart) created by peter
After manually creating a node it should immediately be added to the list …
14:52 Ticket #104 (No way to disable a Node) created by peter
currently all nodes are assumed to be running. If its in the database the …
14:47 Ticket #103 (Nodes View - No way to delete a node) created by peter
There is no way to delete a node via the user interface
14:45 Ticket #64 (Add support for Map Reduce) closed by peter
fixed: code has been merged in. This class (along with every other base class) …
03:31 Changeset [8c41639ffa3a7db135dbbda8e1e94d8cc4d30ea7] by Peter Krenesky <peter@…>
Ticket #8 - Cluster Autodiscovery: Highlights * adds autodiscovery …
03:15 Ticket #102 (jquery should be included in base.html) created by peter
jquery should be included in base.html. nearly every page will use it in …
02:36 Changeset [1becc9b0742a97b5201be449d6798f2e6c53c780] by Peter Krenesky <peter@…>
Merging in mapreduce task Merge  git://github.com/jlg/pydra-map-reduce into …
02:31 Changeset [28a3149eb60e393ba0d181615c428f7a0ceef30f] by Peter Krenesky <peter@…>
removing unused code from old key exchange workflow

07/09/09:

20:04 Ticket #101 (Tasks that fail to import properly are still reported as loading) created by peter
If there is an error while importing a task via task_manager it will still …
18:28 Changeset [879723a0c92c1875e075780509b7bd9f661483ef] by Peter Krenesky <peter@…>
Fixing more imports caused by changing task layout
18:03 Changeset [9fa2f66e4889a1408f12efd962c059a04987d322] by Peter Krenesky <peter@…>
more import fixes
18:01 Changeset [da42714cac549145ef4d13d596f91edc2a911e22] by Peter Krenesky <peter@…>
fixing an import
17:59 Changeset [45dc4093a1856f2ee259db5b64b905c272ead774] by Peter Krenesky <peter@…>
Merge branch 'master' of  ssh://trac.osuosl.org/var/lib/git/pydra
17:55 Changeset [3e51f3b0429e1f2fcdc50690d59a84de86e81223] by Peter Krenesky <peter@…>
starting to cleanup Tasks: * TaskContainer? and ParallelTask? are now in …
17:53 Changeset [41a35318238275c2ce7de00ac1cd40aefca309b1] by Peter Krenesky <peter@…>
Adding deprecated decorator

07/06/09:

01:14 cluster_scheduler edited by peter
(diff)
00:53 cluster/scheduler/proportional created by peter
00:31 Ticket #82 (ParallelTask does not have a progress function) closed by peter
fixed: fixed
00:30 Changeset [2c51e6a4ea8912788194396d875c181a1d6d4a7c] by Peter Krenesky <peter@…>
ticket #82 ParallelTask? does not have a progress function
00:28 Changeset [5dbf107b1b4ea490a6f78aed1dd8b5257939f85d] by Peter Krenesky <peter@…>
Master.fetch_task_status(...) now only fetches status from mainworkers. …
00:27 Changeset [6ae5d00fd3b1109f2752877278be22bd5ebc3ef8] by Peter Krenesky <peter@…>
bugfix: jobs view status updates function was always returning before …

07/05/09:

23:58 Ticket #100 (Nodes View - Fake workers that aren't connected, show that they are ...) created by peter
Create/modify a Node to have more workers than it has available cores. …
23:56 Ticket #99 ([patch] shebang) created by redduck666
start_* scripts don't have a shebang, thus not allowing you to do …
23:54 Changeset [f99e39b5d235f88bcde4650691f12e7a2e80a3c2] by Peter Krenesky <peter@…>
fixed bug in rsa_auth.load_crypto(...): earlier fix to return tuple caused …
21:19 Ticket #98 (UnitTest - Update tests for RSA Handshake via RSAAvatar and RSAClient) created by peter
Recent commits to tie key exchange to the handshake process broke the …
21:16 Ticket #96 (Views do not display error when controller cannot connect because of ...) closed by peter
fixed: Error messages have been improved to indicate more clearly what the …
21:13 Ticket #95 (Jobs Page does not display errors from controller) closed by peter
fixed: errors are now displayed.
21:13 Ticket #97 (AMFController should raise exceptions rather than return codes) closed by peter
fixed
20:42 Changeset [99b7d5a7f91263e1eeeffbf3a534ea5b390fbf27] by Peter Krenesky <peter@…>
Tickets #95, #96, #97 * AMFController now raises exceptions on error …
20:34 Changeset [f37406cc62158a461e50f58591d2110764cfb27f] by Peter Krenesky <peter@…>
adding .pem files to .gitignore
04:20 Changeset [64a9e9ebe5c1b3a49ba1f3aaa793da3c515908a3] by Peter Krenesky <peter@…>
temporary fix for jobs page. this bug should be reconsidered once ticket …
04:19 Ticket #97 (AMFController should raise exceptions rather than return codes) created by peter
AMFController returns error codes when methods are called and fail. The …
04:06 Changeset [7dd32df7751364f7d712dbf718516ad37eee502c] by Peter Krenesky <peter@…>
Add verbose errors to AMFController AMFController now returns errors …
04:04 Changeset [8b4dc07ad7ee2096a22350d5ba4fbbd8e42caefe] by Peter Krenesky <peter@…>
AMFInterface was always returning authenticated instead of returning the …
04:01 Changeset [ccd6fada3386183712e4d977d1e4d4774cf9fb6d] by Peter Krenesky <peter@…>
rsa_auth.load_crypto did not always return the correct response on errors: …

07/04/09:

07:22 Changeset [2f8a7773747b95d1c7a38ac5c335e152fbb57d68] by Peter Krenesky <peter@…>
Major Refactor to integrate Pairing (key exchange) and Authentication …
01:54 Ticket #73 (Node that has never connected before does not start workers) closed by peter
fixed: fixed in commit 9c14d4f40b585f971f192c5f87d9affa89be16c3 key exchange was …
01:51 Ticket #96 (Views do not display error when controller cannot connect because of ...) created by peter
The controller requires an ssl key to connect to the Master. An error is …
01:48 Ticket #95 (Jobs Page does not display errors from controller) created by peter
The jobs page does not display errors at the top of the page when the …
01:44 Changeset [3e1d5e9d727e00b6ff999df9630506ba60792879] by Peter Krenesky <peter@…>
bugfix: jobs page displayed error if Controller was unable to connect to …
01:44 Changeset [a66f577588d321cac2296e1639d25eca33a3e0a9] by Peter Krenesky <peter@…>
adding .gitignore
01:34 installation edited by peter
(diff)
01:18 Changeset [0b97ae5b4564283e972578159db48546687cda24] by Peter Krenesky <peter@…>
Adding convenience scripts for starting master and node

07/03/09:

05:01 Changeset [805d1c61be75c914c48036dafe524019fd6270ef] by Peter Krenesky <peter@…>
Merge branch 'master' of  ssh://trac.osuosl.org/var/lib/git/pydra
04:55 Changeset [9c14d4f40b585f971f192c5f87d9affa89be16c3] by Peter Krenesky <peter@…>
Refactor of Master-Node pairing workflow to fix: * bug where if key …

07/01/09:

16:22 cluster_scheduler edited by peter
(diff)
15:26 cluster_scheduler edited by peter
(diff)
14:54 cluster_scheduler edited by peter
(diff)
14:42 cluster_scheduler edited by peter
(diff)
14:24 cluster_scheduler edited by peter
(diff)
14:22 cluster_scheduler edited by peter
(diff)
14:22 cluster_scheduler edited by peter
(diff)
13:41 cluster_scheduler edited by peter
(diff)
13:36 cluster_scheduler edited by peter
(diff)

06/30/09:

16:41 git edited by peter
(diff)
16:32 Changeset [6e933557ac0c675316a16c3aa2a3f7ca15e1b0fa] by Peter Krenesky <peter@…>
Adding readme - nothing in it yet
15:25 cluster_scheduler edited by peter
(diff)
15:18 cluster_scheduler edited by peter
(diff)
15:15 cluster_scheduler edited by peter
(diff)
15:08 scheduler_sequence_2.png attached to cluster_scheduler by peter
scheduler sequence
15:07 scheduler_sequence_1.png attached to cluster_scheduler by peter
scheduler sequence
15:02 cluster_scheduler edited by peter
(diff)
14:54 cluster_scheduler created by peter
14:20 documentation edited by peter
(diff)
14:20 documentation edited by peter
(diff)
14:06 git edited by peter
(diff)
14:06 WikiStart edited by peter
(diff)
13:57 git created by peter
05:02 Ticket #94 (master node adding) closed by redduck666
invalid
04:27 Ticket #94 (master node adding) created by redduck666
master should be able to have nodes added without restarting
03:55 Changeset [9dd979c4128fdf82aafbf715f8ba62bbd5044d90] by Peter Krenesky <peter@…>
replacing unused property node_base with node, and putting it to use for …
Note: See TracTimeline for information about the timeline view.