February 2010 - Diswork-commits - mailman.cloud.codelutin.com

r7 - diswork/trunk/src/site/rst/devel
by echatellier＠users.nuiton.org Feb. 24, 2010

Feb. 24, 2010

Author: echatellier Date: 2010-02-24 16:53:37 +0100 (Wed, 24 Feb 2010) New Revision: 7 Modified: diswork/trunk/src/site/rst/devel/draft.rst Log: Small update about software on trackers Modified: diswork/trunk/src/site/rst/devel/draft.rst =================================================================== --- diswork/trunk/src/site/rst/devel/draft.rst 2010-02-22 14:54:51 UTC (rev 6) +++ diswork/trunk/src/site/rst/devel/draft.rst 2010-02-24 15:53:37 UTC (rev 7) @@ -19,7 +19,7 @@ et les télécharges (P2P ?) Storage -------- +~~~~~~~ Pour les serveurs de stockage, il recherche a duplique l'information qui ne l'est pas assez. Par exemple dans l'annuaire, un resultat est marque comme ayant une disponibilite de 1 (une seul machine active a @@ -31,6 +31,10 @@ (surtout pour le stockage on se n'est pas une approche vraiment naturelle) +Tracker +~~~~~~~ +Les trackers possèdent les logiciels de simulation. + Détails ------- - Utilisation d'algorithme efficace pour découvrir l'ensemble des noeuds

1 0

r6 - diswork/trunk
by echatellier＠users.nuiton.org Feb. 22, 2010

Feb. 22, 2010

Author: echatellier Date: 2010-02-22 15:54:51 +0100 (Mon, 22 Feb 2010) New Revision: 6 Modified: diswork/trunk/ Log: Fix svn:ignore Property changes on: diswork/trunk ___________________________________________________________________ Added: svn:ignore + .settings target .classpath .project

1 0

r5 - in diswork/trunk/src/site: . rst rst/devel rst/user
by echatellier＠users.nuiton.org Feb. 22, 2010

Feb. 22, 2010

Author: echatellier Date: 2010-02-22 15:53:53 +0100 (Mon, 22 Feb 2010) New Revision: 5 Added: diswork/trunk/src/site/rst/ diswork/trunk/src/site/rst/devel/ diswork/trunk/src/site/rst/devel/draft.rst diswork/trunk/src/site/rst/index.rst diswork/trunk/src/site/rst/user/ diswork/trunk/src/site/rst/user/install.rst diswork/trunk/src/site/rst/user/starting.rst diswork/trunk/src/site/site_en.xml Log: Init diswork site Added: diswork/trunk/src/site/rst/devel/draft.rst =================================================================== --- diswork/trunk/src/site/rst/devel/draft.rst (rev 0) +++ diswork/trunk/src/site/rst/devel/draft.rst 2010-02-22 14:53:53 UTC (rev 5) @@ -0,0 +1,80 @@ +Diswork first draft +=================== + + +Principe +-------- +3 types de machines : annuaires (uptime très grand), stockage (beaucoup de HDD), +calculateur (beaucoup de CPU). Un noeud (une machine physique) peut être d'un ou +plusieurs type. +Les annuaires sont reliés entre eux en DHT (Distributed Hashtable). +Potentiellement 1 ou 2 serveurs existent pour indiquer les point d'entrées +dans le réseau pour pouvoir fonctionner hors d'un réseau local. +Un client envoie aux annuaires les simulations qu'il doit effectuer : version du +simulateur et data. +Quand un calculateur a du temps, il demande à l'annuaire ce qu'il doit faire. +Récupère une simu, le simulateur approprié si il ne l'a pas (P2P ?) fait tourner +la simu et dit aux stockages que les résultats sont dispo. Réplication des +résultats entre les stockages. Client demande à l'annuaire où sont les résultats +et les télécharges (P2P ?) + +Storage +------- +Pour les serveurs de stockage, il recherche a duplique l'information +qui ne l'est pas assez. Par exemple dans l'annuaire, un resultat est +marque comme ayant une disponibilite de 1 (une seul machine active a +l'avoir) alors un serveur de stockage au repos va essaye de recuperer +ce resultat pour augmenter ce taux de partage. + +Il faut bien penser que l'intelligence est dans les serveurs qui +veulent faire du travail, pas dans un serveur qui repartira les choses +(surtout pour le stockage on se n'est pas une approche vraiment +naturelle) + +Détails +------- +- Utilisation d'algorithme efficace pour découvrir l'ensemble des noeuds +- Un noued peut se contenter de ne connaitre que ces voisins (annuaire, stockage, calculateur) +- Un peu de config pour que le calculateur puisse choisir les applis qui ont le droit de tourner +- Quand résultats sont produits, aucun calculateur ne peut plus démarrer la simu +- Il faut optimiser les simulations a faire pour que le maximum de calculateur en fasse le plus de differente +- Plusieurs calculateur peuvent effectuer la même simulation +- Les calculateurs gere eux même les simulations en erreur (telle simulation a echoué 2 fois, je ne la fait plus) +- Le client peut télécharger les résultats depuis plusieurs noeud de stockage (P2P) +- Communication : utiliser HTTP pour éviter les firewall +- Vérification d'un ckecksum sur les logiciels de simulation (et les résultats?) +- Voir comment faire entrer Caparmor dans le réseau (noeud qui délègue à Caparmor ?) +- Mettre en pause la simulation quand l'utilisateur se ressert de son poste +- Detecter que l'utilisateur ne se sert plus de son poste pour lancer les simulations (inactivité, pas de charge cpu) +- Postes windows, utilisation d'un screensaver ? (diswork en cours) +- Les noeuds savent se mettre à jour (ou détecter qu'il ne sont pas à jour) +- Bonne gestion de l'espace disque sur les noeuds de stockage +- Systèmes de statistique pour insiter à offrir du stockage, du cpu, des annuaires (bonus) + + +Contacts +-------- +- Gerson Sunye pour le DHT +- Lamarre pour le plus haut niveau (les algos de recherche/decouverte...) +- TMG pour le P2P (on va avoir les mêmes problématiques : connexion entrante sur un pair qui n'est pas un serveur) + + +Technique +--------- +- JXTA : protocole P2P +- rechercher s'il n'y a pas d'autre librairie utilisable. Par exemple +regarder dans les implantations java bittorrent s'il n'y a pas des +choses recuperables (vuze, ...) + + +Premier objectif +---------------- +Bonne structure de l'annuaire. +Etude des protocoles. +Solutionnement des problématiques de communication (firewall). + +Fonctionne sans réplication des données. +Fonctionne sans téléchargement depuis plusieurs sources. + +La version 1.0.0 doit être entierement fonctionnelle (sans contenir toutes les +fonctionnalités) \ No newline at end of file Added: diswork/trunk/src/site/rst/index.rst =================================================================== --- diswork/trunk/src/site/rst/index.rst (rev 0) +++ diswork/trunk/src/site/rst/index.rst 2010-02-22 14:53:53 UTC (rev 5) @@ -0,0 +1,16 @@ +Presentation +============ + +Diswork is a `distributed computing`_ library writen in Java_ used to run Java_ +application. + +References +---------- +Here is a list a client application that use Diswork_ : + * IsisFish_ (*soon*) + + +.. _Diswork: http://maven-site.nuiton.org/diswork +.. _Java: http://java.sun.com/ +.. _distributed computing: http://en.wikipedia.org/wiki/Distributed_computing +.. _IsisFish: http://isis-fish.labs.libre-entreprise.org/ \ No newline at end of file Added: diswork/trunk/src/site/rst/user/install.rst =================================================================== --- diswork/trunk/src/site/rst/user/install.rst (rev 0) +++ diswork/trunk/src/site/rst/user/install.rst 2010-02-22 14:53:53 UTC (rev 5) @@ -0,0 +1,5 @@ +Install +======= + +TODO: client use +TODO: server use \ No newline at end of file Added: diswork/trunk/src/site/rst/user/starting.rst =================================================================== --- diswork/trunk/src/site/rst/user/starting.rst (rev 0) +++ diswork/trunk/src/site/rst/user/starting.rst 2010-02-22 14:53:53 UTC (rev 5) @@ -0,0 +1,4 @@ +Starting with Diswork +===================== + +TODO : maybe put here a "hello world" application running on diswork \ No newline at end of file Added: diswork/trunk/src/site/site_en.xml =================================================================== --- diswork/trunk/src/site/site_en.xml (rev 0) +++ diswork/trunk/src/site/site_en.xml 2010-02-22 14:53:53 UTC (rev 5) @@ -0,0 +1,33 @@ +<?xml version="1.0" encoding="UTF-8"?> +<project name="${project.name}"> + + <bannerLeft> + <name>${project.name}</name> + <href>index.html</href> + </bannerLeft> + + <poweredBy> + <logo href="http://maven.apache.org" name="Maven" img="images/logos/maven-feather.png"/> + <logo href="http://jrst.labs.libre-entreprise.org" name="JRst" img="images/jrst-logo.png"/> + <logo href="http://docutils.sourceforge.net/rst.html" name="ReStructuredText" img="images/restructuredtext-logo.png"/> + </poweredBy> + + <body> + + <breadcrumbs> + <item name="${project.name}" href="index.html" /> + </breadcrumbs> + + <menu name="Users"> + <item href="user/install.html" name="Install"/> + <item href="user/starting.html" name="Starting"/> + </menu> + + <menu name="Developer"> + <item href="devel/draft.html" name="First draft"/> + </menu> + + <menu ref="reports"/> + + </body> +</project>

1 0

r4 - in diswork/trunk: . src
by echatellier＠users.nuiton.org Feb. 22, 2010

Feb. 22, 2010

Author: echatellier Date: 2010-02-22 15:53:42 +0100 (Mon, 22 Feb 2010) New Revision: 4 Added: diswork/trunk/LICENSE.txt diswork/trunk/README.txt diswork/trunk/changelog.txt diswork/trunk/pom.xml diswork/trunk/src/ diswork/trunk/src/site/ Log: Init diswork pom Added: diswork/trunk/LICENSE.txt =================================================================== --- diswork/trunk/LICENSE.txt (rev 0) +++ diswork/trunk/LICENSE.txt 2010-02-22 14:53:42 UTC (rev 4) @@ -0,0 +1,166 @@ + GNU LESSER GENERAL PUBLIC LICENSE + Version 3, 29 June 2007 + + Copyright (C) 2007 Free Software Foundation, Inc. <http://fsf.org/> + Everyone is permitted to copy and distribute verbatim copies + of this license document, but changing it is not allowed. + + + This version of the GNU Lesser General Public License incorporates +the terms and conditions of version 3 of the GNU General Public +License, supplemented by the additional permissions listed below. + + 0. Additional Definitions. + + As used herein, "this License" refers to version 3 of the GNU Lesser +General Public License, and the "GNU GPL" refers to version 3 of the GNU +General Public License. + + "The Library" refers to a covered work governed by this License, +other than an Application or a Combined Work as defined below. + + An "Application" is any work that makes use of an interface provided +by the Library, but which is not otherwise based on the Library. +Defining a subclass of a class defined by the Library is deemed a mode +of using an interface provided by the Library. + + A "Combined Work" is a work produced by combining or linking an +Application with the Library. The particular version of the Library +with which the Combined Work was made is also called the "Linked +Version". + + The "Minimal Corresponding Source" for a Combined Work means the +Corresponding Source for the Combined Work, excluding any source code +for portions of the Combined Work that, considered in isolation, are +based on the Application, and not on the Linked Version. + + The "Corresponding Application Code" for a Combined Work means the +object code and/or source code for the Application, including any data +and utility programs needed for reproducing the Combined Work from the +Application, but excluding the System Libraries of the Combined Work. + + 1. Exception to Section 3 of the GNU GPL. + + You may convey a covered work under sections 3 and 4 of this License +without being bound by section 3 of the GNU GPL. + + 2. Conveying Modified Versions. + + If you modify a copy of the Library, and, in your modifications, a +facility refers to a function or data to be supplied by an Application +that uses the facility (other than as an argument passed when the +facility is invoked), then you may convey a copy of the modified +version: + + a) under this License, provided that you make a good faith effort to + ensure that, in the event an Application does not supply the + function or data, the facility still operates, and performs + whatever part of its purpose remains meaningful, or + + b) under the GNU GPL, with none of the additional permissions of + this License applicable to that copy. + + 3. Object Code Incorporating Material from Library Header Files. + + The object code form of an Application may incorporate material from +a header file that is part of the Library. You may convey such object +code under terms of your choice, provided that, if the incorporated +material is not limited to numerical parameters, data structure +layouts and accessors, or small macros, inline functions and templates +(ten or fewer lines in length), you do both of the following: + + a) Give prominent notice with each copy of the object code that the + Library is used in it and that the Library and its use are + covered by this License. + + b) Accompany the object code with a copy of the GNU GPL and this license + document. + + 4. Combined Works. + + You may convey a Combined Work under terms of your choice that, +taken together, effectively do not restrict modification of the +portions of the Library contained in the Combined Work and reverse +engineering for debugging such modifications, if you also do each of +the following: + + a) Give prominent notice with each copy of the Combined Work that + the Library is used in it and that the Library and its use are + covered by this License. + + b) Accompany the Combined Work with a copy of the GNU GPL and this license + document. + + c) For a Combined Work that displays copyright notices during + execution, include the copyright notice for the Library among + these notices, as well as a reference directing the user to the + copies of the GNU GPL and this license document. + + d) Do one of the following: + + 0) Convey the Minimal Corresponding Source under the terms of this + License, and the Corresponding Application Code in a form + suitable for, and under terms that permit, the user to + recombine or relink the Application with a modified version of + the Linked Version to produce a modified Combined Work, in the + manner specified by section 6 of the GNU GPL for conveying + Corresponding Source. + + 1) Use a suitable shared library mechanism for linking with the + Library. A suitable mechanism is one that (a) uses at run time + a copy of the Library already present on the user's computer + system, and (b) will operate properly with a modified version + of the Library that is interface-compatible with the Linked + Version. + + e) Provide Installation Information, but only if you would otherwise + be required to provide such information under section 6 of the + GNU GPL, and only to the extent that such information is + necessary to install and execute a modified version of the + Combined Work produced by recombining or relinking the + Application with a modified version of the Linked Version. (If + you use option 4d0, the Installation Information must accompany + the Minimal Corresponding Source and Corresponding Application + Code. If you use option 4d1, you must provide the Installation + Information in the manner specified by section 6 of the GNU GPL + for conveying Corresponding Source.) + + 5. Combined Libraries. + + You may place library facilities that are a work based on the +Library side by side in a single library together with other library +facilities that are not Applications and are not covered by this +License, and convey such a combined library under terms of your +choice, if you do both of the following: + + a) Accompany the combined library with a copy of the same work based + on the Library, uncombined with any other library facilities, + conveyed under the terms of this License. + + b) Give prominent notice with the combined library that part of it + is a work based on the Library, and explaining where to find the + accompanying uncombined form of the same work. + + 6. Revised Versions of the GNU Lesser General Public License. + + The Free Software Foundation may publish revised and/or new versions +of the GNU Lesser General Public License from time to time. Such new +versions will be similar in spirit to the present version, but may +differ in detail to address new problems or concerns. + + Each version is given a distinguishing version number. If the +Library as you received it specifies that a certain numbered version +of the GNU Lesser General Public License "or any later version" +applies to it, you have the option of following the terms and +conditions either of that published version or of any later version +published by the Free Software Foundation. If the Library as you +received it does not specify a version number of the GNU Lesser +General Public License, you may choose any version of the GNU Lesser +General Public License ever published by the Free Software Foundation. + + If the Library as you received it specifies that a proxy can decide +whether future versions of the GNU Lesser General Public License shall +apply, that proxy's public statement of acceptance of any version is +permanent authorization for you to choose that version for the +Library. + Added: diswork/trunk/pom.xml =================================================================== --- diswork/trunk/pom.xml (rev 0) +++ diswork/trunk/pom.xml 2010-02-22 14:53:42 UTC (rev 4) @@ -0,0 +1,135 @@ +<?xml version="1.0" encoding="UTF-8"?> +<project xmlns="http://maven.apache.org/POM/4.0.0" + xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> + + <modelVersion>4.0.0</modelVersion> + +  +  +  + + <parent> + <groupId>org.nuiton</groupId> + <artifactId>mavenpom4redmine</artifactId> + <version>2.0.5</version> + </parent> + + <artifactId>diswork</artifactId> + <version>0.0.1-SNAPSHOT</version> + + <dependencies> + + <dependency> + <groupId>commons-logging</groupId> + <artifactId>commons-logging</artifactId> + <version>1.1.1</version> + <scope>compile</scope> + </dependency> + + <dependency> + <groupId>log4j</groupId> + <artifactId>log4j</artifactId> + <version>1.2.14</version> + <scope>test</scope> + </dependency> + + <dependency> + <groupId>junit</groupId> + <artifactId>junit</artifactId> + <version>4.7</version> + <scope>test</scope> + </dependency> + + + </dependencies> + +  +  +  + + <name>Diswork</name> + <description>Distributed computing application</description> + <inceptionYear>2010</inceptionYear> + <url>http://maven-site.nuiton.org/diswork</url> + + <developers> + <developer> + <name>Benjamin Poussin</name> + <id>bpoussin</id> + <email>poussin(a)codelutin.com</email> + <organization>CodeLutin</organization> + <timezone>+2</timezone> + <roles> + <role>Développeur</role> + <role>Debian packager</role> + </roles> + </developer> + <developer> + <name>Eric Chatellier</name> + <id>echatellier</id> + <email>chatellier(a)codelutin.com</email> + <organization>CodeLutin</organization> + <timezone>+2</timezone> + <roles> + <role>Développeur</role> + </roles> + </developer> + <developer> + <name>Jean Couteau</name> + <id>jcouteau</id> + <email>couteau(a)codelutin.com</email> + <organization>CodeLutin</organization> + <timezone>+2</timezone> + <roles> + <role>Développeur</role> + </roles> + </developer> + </developers> + +  +  +  + + <packaging>jar</packaging> + + <properties> + <siteLocales>en</siteLocales> + </properties> + + <build> + <plugins> + + </plugins> + + <pluginManagement> + <plugins> + + <plugin> + <artifactId>maven-site-plugin</artifactId> + <dependencies> + <dependency> + <groupId>org.nuiton.jrst</groupId> + <artifactId>doxia-module-jrst</artifactId> + <version>${jrst.version}</version> + </dependency> + </dependencies> + </plugin> + + </plugins> + </pluginManagement> + + </build> + +  +  +  + +  + <scm> + <connection>scm:svn:http://svn.nuiton.org/svn/diswork/diswork/trunk</connection> + <developerConnection>scm:svn:http://svn.nuiton.org/svn/diswork/diswork/trunk</developerConnection> + <url>http://www.nuiton.org/repositories/browse/diswork/diswork/trunk</url> + </scm> + +</project>

1 0

r3 - diswork
by echatellier＠users.nuiton.org Feb. 22, 2010

Feb. 22, 2010

Author: echatellier Date: 2010-02-22 11:58:45 +0100 (Mon, 22 Feb 2010) New Revision: 3 Added: diswork/branches/ Log: Init diswork repo

1 0

r2 - diswork
by echatellier＠users.nuiton.org Feb. 22, 2010

Feb. 22, 2010

Author: echatellier Date: 2010-02-22 11:58:38 +0100 (Mon, 22 Feb 2010) New Revision: 2 Added: diswork/tags/ Log: Init diswork repo

1 0