ࡱ> `:bjbj"B4444444T`54bbbbDb7πtc e e e e ef|f@Ch\u4i e eii44 e ettti4 e4 etittz|44{ ec p{9brlB{^|0π{0t${4{\fg|thdfhxfff0tXfffπiiii777D)`D777`>5R5`5444444  FedStage Grid Application Framework - LSF DRMAA 1.0 Implementation Report (Ver. 6) Status of This Document This document provides information to the Grid community about the adoption of the OGF specification GFD-R-P.022 in the Platform LSF workload management system, Open DRMAA Service Provider (OpenDSP) and FedStage Computing Provider. It does not define any standards or technical recommendations. Distribution is unlimited. List of Changes Integrations status (between OpenDSP and Platform LSF) (point 1) Extension of testing description (point 2) Updated statuses of library tests (point 2) Updated known issues about current implementation (entire point 3) Major changes in point 3 updates to implentations comments take into account the feedback from Platform LSF Copyright Notice Copyright Open Grid Forum 2007. All Rights Reserved. Trademark Open Grid Services Architecture and OGSA are trademarks of the Open Grid Forum. LSF is a registered trademark of Platform Computing Corporation in the United States and in other jurisdictions. FedStage is a registered trademark of FedStage Systems Company in European Union and in other jurisdictions. UNIX is a registered trademark of The Open Group in the United States and in other jurisdictions. Abstract This document describes experiences in the implementation of the Distributed Resource Management Application API (DRMAA) specification for the Platform LSF workload management, Open DRMAA Service Provider (OpenDSP) and FedStage Computing Provider. The document reports about issues that where identified during implementation and test of a Grid Application Framework - LSF DRMAA 1.0 library for Platform LSF, which was evaluated successfully with the DRMAA working group compliance test for C bindings. Suggestions for improvement of the specification, mainly concerning readability of the GFD-R-P.022 specification document were given in [4] and are not part of this document. Contents  TOC \o "1-9" \t "NagBwek 9;9;NagBwek 8;8;NagBwek 7;7;NagBwek 6;6;NagBwek 5;5;NagBwek 4;4;NagBwek 3;3;NagBwek 2;2;NagBwek 1;1;NagBwek 1;1;NagBwek 1;1;NagBwek 1;1;TytuB;1;NagBwek 2;2;NagBwek 2;2;NagBwek 2;2;PodtytuB;2;NagBwek 3;3;NagBwek 3;3;NagBwek 3;3;NagBwek 4;4;NagBwek 4;4;NagBwek 4;4;NagBwek 5;5;NagBwek 5;5;NagBwek 5;5;NagBwek 6;6;NagBwek 6;6;NagBwek 6;6;NagBwek 7;7;NagBwek 7;7;NagBwek 7;7;NagBwek 8;8;NagBwek 8;8;NagBwek 8;8;NagBwek 9;9;NagBwek 9;9;NagBwek 9;9" \h HYPERLINK \l "_toc54" Abstract 1  HYPERLINK \l "_toc77"1. Introduction 3  HYPERLINK \l "_toc94"2. Platform LSF experience report 3  HYPERLINK \l "_toc363"3. Grid Application Framework - LSF DRMAA 1.0 implementation issues 6  HYPERLINK \l "_toc364" Job attributes comments 6  HYPERLINK \l "_toc383" Job exit status 7  HYPERLINK \l "_toc389" Multi threaded version 7  HYPERLINK \l "_toc396"4. Further development 7  HYPERLINK \l "_toc409"5. Security Considerations 7  HYPERLINK \l "_toc411"6. Contributors 7  HYPERLINK \l "_toc418"7. Intellectual Property Statement 8  HYPERLINK \l "_toc423"8. Disclaimer 8  HYPERLINK \l "_toc426"9. Full Copyright Notice 8  HYPERLINK \l "_toc433"10. References 8 Introduction The Distributed Resource Management Application API document (GFD-R.P.022) [1] specifies a generalized API to distributed resource management systems (DRMs) in order to facilitate integration of application programs. Soon after DRMAA reached "proposed recommendation" status, various DRM vendors and Grid community-oriented projects started implementing DRMAA language bindings. Today, there are implementations for DRM systems, such as Sun Grid Engine, Condor and Torque/PBS as well as different languages (C, Java, Perl, Python). Grid Application Framework - LSF DRMAA 1.0 library [2] is an implementation of mentioned Open Grid Forum DRMAA specification GFD-R.P.022 for Platform LSF. The scope of the API covered all the high level functionality required for Grid applications to consign jobs to LSF, and it included common operations on jobs like termination or suspension. This library enables also the integration of OpenDSP with the underlying Platform LSF system. Open DRMAA Service Provider (OpenDSP) [3] is an open source implementation of SOAP Web Service which provides on-demand and multi-user compute capacity for remote applications and services. It enables to build a secure virtual computing environment and take advantage of a large number of computing resources managed by a resource management system. Local DRMs are integrated efficiently with OpenDSP via DRMAA (Distributed Resource Management Application API) routines defined in GFD-R.P.022. OpenDSP exposes to the Internet multi-user access and common remote job management capabilities supported by various DRMs such as: SGE 6u7+, Condor 6.9+, PBS/Torque 2.1.3+, Platform LSF 6.2 and Platform LSF 7.0. OpenDSP is also using another OGF based JSDL-based XML schema with some extensions to describe the requirements of computational jobs for submission to underlying DRMs. FedStage Computing Provider is an extension of OpenDSP providing a secure Web Service based access to remote HPC computing resources. Additionally, it has been integrated with various Federated Service Bus services and thus can be easily incorporated with existing SOA/SOI based IT infrastructures over OASIS WS-* [8] and Liberty Alliance [9] industry standards. Both OpenDSP and FedStage Computing Provider are distributed under a business friendly license and commercially supported by FedStage Systems Inc. [2]. Platform LSF experience report The DRMAA C compliance testsuite is an application which tests for binary compatibility of a DRMAA C binding implementation with the DRMAA C binding specification. The DRMAA C testsuite includes over 40 tests which check various aspects of compliance of the binding implementation. The test application also includes an automated test, which runs all of the other tests in series and reports comprehensively on compliance. This automated test were developed to verify the compliance of the N1 Grid Engine 6.0 update 9 DRM system DRMAA C binding implementation. Testing Below we list the tests results of DRMAA library (version 0.1b) for Platform LSF 6.2. Several tests needed an additional explanation and were commented beneath the table. The library were tested on Kubuntu 6.06 (x86) with Platform LSF 6.2 (linux v2.6, glibc v2.3). RedHat Linux 3.2.3-42 (ia64) with Platform LSF 6.2 (linux v2.4, glibc v2.3) Gentoo Linux (amd64) with Platform LSF 7.0 (linux v2.6, glibc v2.3) DRMAA 1.0 C compliance test nameStatusST_MULT_INIT OKST_MULT_EXIT OKST_SUPPORTED_ATTR OK1ST_SUPPORTED_VATTR OK2ST_VERSION OKST_DRM_SYSTEM OKST_DRMAA_IMPL OKST_CONTACT OKST_EMPTY_SESSION_WAIT OKST_EMPTY_SESSION_SYNCHRONIZE_DISPOSE OKST_EMPTY_SESSION_SYNCHRONIZE_NODISPOSE OKST_SUBMIT_WAIT OKST_BULK_SUBMIT_WAIT OKST_BULK_SINGLESUBMIT_WAIT_INDIVIDUAL OKST_SUBMITMIXTURE_SYNC_ALL_DISPOSE OKST_SUBMITMIXTURE_SYNC_ALL_NODISPOSE OKST_SUBMITMIXTURE_SYNC_ALLIDS_DISPOSE OKST_SUBMITMIXTURE_SYNC_ALLIDS_NODISPOSE OKST_EXIT_STATUSOK3ST_SUBMIT_KILL_SIG OK4ST_INPUT_FILE_FAILURE OKST_OUTPUT_FILE_FAILURE OKST_ERROR_FILE_FAILURE OKST_SUBMIT_IN_HOLD_RELEASE OKST_SUBMIT_IN_HOLD_DELETE OKST_BULK_SUBMIT_IN_HOLD_SESSION_RELEASE OKST_BULK_SUBMIT_IN_HOLD_SINGLE_RELEASE OKST_BULK_SUBMIT_IN_HOLD_SESSION_DELETEOKST_BULK_SUBMIT_IN_HOLD_SINGLE_DELETEOKST_SUBMIT_POLLING_WAIT_TIMEOUT OKST_SUBMIT_POLLING_WAIT_ZEROTIMEOUT OKST_SUBMIT_POLLING_SYNCHRONIZE_TIMEOUT OKST_SUBMIT_POLLING_SYNCHRONIZE_ZEROTIMEOUT OKST_ATTRIBUTE_CHANGE OKST_SUBMIT_SUSPEND_RESUME_WAIT OKST_USAGE_CHECK OKMT_SUBMIT_WAIT OKMT_SUBMIT_BEFORE_INIT_WAIT OKMT_EXIT_DURING_SUBMIT OKMT_SUBMIT_MT_WAIT OKMT_EXIT_DURING_SUBMIT_OR_WAITOK 1,2) Not all attributes are implemented according to standard, please see the part about implementation issues for further information 3) Exit status test succeeds only for exit code from 0 up to 127, please see the part about implementation issues for further information 4) For unknown reason the SIGHUP test fails, please see the part about implementation issues for further information Grid Application Framework - LSF DRMAA 1.0 implementation issues Job attributes comments DRMAA_WD: Platform LSF takes working directory from submission host environment. The actual working directory used will depend on automounter settings, mount paths, account mapping settings, OS mappings (e.g. linux -> windows), job starter (e.g. the job starter is free to set the working directory to any envi var specified by the user if desired), or will default to /tmp/$LSB_JOBID if nothing can be resolved. All this settings depend on system configuration and DRMAA library cannot make assumptions about them. Therefore DRMAA library make a call of proper chdir before submission. This however creates a restriction that DRMAA_WD must exists on submission host. This also disallows the use DRMAA_PLACEHOLDER_INCR (thus this functionality is not implemented). DRMAA_*_FILE: Placeholder DRMA_PLACEHOLDER_INCR is not implemented yet. Platform LSF supports this functionality (one can use placeholders in paths by building in %J (jobid) or %I (array index) or any environment variable in the context of the execution host) DRMAA_V_ENV: Platform LSF takes environment variables from the submission host (if system is properly configured to do so using preservestarter and augmentstarter, this is however out of scope of DRMAA library). Therefore DRMAA library uses putenv to set the environment properly. The issue with DRMAA_V_ENV (known from previous version of LSF DRMAA library) has been resolved entirely. DRMAA_BLOCK_EMAIL: Platform LSF blocks sending e-mail when the output file of the submitted application is set. Therefore if no output file is set by DRMAA (user did not set DRMAA_OUTPUT_FILE job attribute) and the DRMAA_BLOCKING_EMAIL is set by the user, the library will set the output file to /dev/null (which will block sending e-mail notifications). DRMAA_V_EMAIL: Platform LSF allows sending e-mail to one, single user. The e-mail will be send to the first e-mail address from the DRMAA_V_EMAIL vector. DRMAA_JOB_CATEGORY: currently this attribute is mapped into Job Group, which is not a good mapping. This can be resolved by using esub script to interpret this job group as a job category. This is done by using a option with comman-line tool bsub and DOES NOT HAVE an API equivalent, thus it cannot be used in DRMAA library . Perhaps new features of Platform LSF 7.0 would resolve this issues (the possibility of specifying so-called jobs application). This means however, that propably DRMAA library for LSF 6.2 will have this funcionality disabled DRMAA_JOIN_FILES is now fully implemented DRMAA_NATIVE_SPECIFICATION and DRMAA_START_TIME are not yet implemented. There are no known issues concerning them, they will be added to next Platform LSF DRMAA library release. No optional job attributes are implemented. Some of them will be included in the next release. Job exit status In some environments (execution host), exit statuses bigger or equal 0 and less then 128 are supported. Platform LSF does not interfere with the exit status received from the system, so this issue must be tested on different OSs. Curently it is advised to use exit codes from range [0, 127] (including both ends). Job signal For unknown reason signal SIGHUP does not work (as it does not influence running job at all). Perhaps it is a testbed issue. Other supported signals are handled correctly. Multi threaded version DRMAA for Platform LSF v0.1b is now implemented to work in the multithreaded environment. Other issues DRMAA rusage is now filled with information when the job finishes. However all of the fileds of the JobInfoEnt.jRusage are set to 1. It occured that jRusage is used only during runtime. The resource usege after job completion must be retreived from account log file. This needs to be implemented. Further development This points should be considered as guidelines for further Grid Application Framework - LSF DRMAA 1.0 development: Further implementation of missing job attributes (both required and optional). The attributes values passed by the user (using DRMAA calls) must be checked more minutely against all errors and possible abuses. The more convenient logging routines must be implemented. Library should be tested on various operating systems, including various Linux systems, FreeBSD, Mac OS, Solaris, Windows, etc. A detailed documentation of the DRMAA library for Platform LSF implementation must yet be provided. Security Considerations Security issues are not discussed in this document. For security considerations of the DRMAA specification, please refer to the GFD-R-P.022 document. Contributors Piotr Domagalski, FedStage Systems Krzysztof Kurowski, FedStage Systems PaweB Lichocki, FedStage Systems Chris Smith, Platform Computing Inc. Intellectual Property Statement The OGF takes no position regarding the validity or scope of any intellectual property or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; neither does it represent that it has made any effort to identify any such rights. Copies of claims of rights made available for publication and any assurances of licenses to be made available, or the result of an attempt made to obtain a general license or permission for the use of such proprietary rights by implementers or users of this specification can be obtained from the OGF Secretariat. The OGF invites any interested party to bring to its attention any copyrights, patents or patent applications, or other proprietary rights which may cover technology that may be required to practice this recommendation. Please address the information to the OGF Executive Director. Disclaimer This document and the information contained herein is provided on an As Is basis and the OGF disclaims all warranties, express or implied, including but not limited to any warranty that the use of the information herein will not infringe any rights or any implied warranties of merchantability or fitness for a particular purpose. Full Copyright Notice Copyright (C) Open Grid Forum (2007) All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. However, this document itself may not be modified in any way, such as by removing the copyright notice or references to the OGF or other organizations, except as needed for the purpose of developing Grid Recommendations in which case the procedures for copyrights defined in the OGF Document process must be followed, or as required to translate it into languages other than English. The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees. References Note that only permanent documents should be cited as references. Other items, such as Web pages or working groups, should be cited inline (i.e., see the Open Grid Forum, http://www.ogf.org). References should conform to a standard such as used by IEEE/ACM, MLA, Chicago or similar. Include an author, year, title, publisher, place of publication. For online materials, also add a URL. It is acceptable to separate out normative references, as IETF documents typically do. Some sample citations: [1] Hrabri Rajic, Roger Brobst, Waiman Chan, Fritz Ferstl, Jeff Gardiner, Andreas Haas, Bill Nitzberg, and John Tollefsrud. Distributed Resource Management Application API Specification 1.0. http://forge.ggf.org/projects/drmaa-wg/, 2004. [2] FedStage Grid Application Framework - LSF DRMAA 1.0 library, http://www.fedstage.com/ogf/drmaa [3] Open DRMAA Service Provider v.1.0, http://sourceforge.net/projects/opendsp/, 2006 [4] Lukasz Cie[nik, Piotr Domagalski, Krzysztof Kurowski, PaweB Lichocki, PBS/Torque DRMAA 1.0 Implementation  Experience Report, 2007 [5] Platform LSF API Reference, Version 6.2, November 2005 [6] Using the Platform LSF SDK, VersDJRTUmW X  " F \ f g f x B M U"#$%<=>OPQRiκΩ΢ۯۚۏۚ|ۚjohNUhN0JN_HjhNUjhNU hN6_H hL_HhN>*_HmHsHhN_HmHsHhN_HmHsH hN_H hN>*_HhN hs55hN5mHsH hN5hNOJQJ_HmHsH0TUmnW X  2 ^   " # [ \ f g ( $ & F a$$a$8  $Q*Y+l   & F h!  !  !  ! $a$ & F$ a$ijk  ()*+CDEWXYZrst)*+,DjhNUjhNUjhNUjhNUj/hNUjhNUjMhNUhNhN0JN_HjhNUjhNU8DEFjklm -H !"V쵨xhhNCJOJQJaJmH sH hNCJaJmHsHhCJaJmH sH hP(CJaJmH sH hNCJaJmH sH hN5KH_HmHsHhN_HmHsHjhNUjFhNUjhNUhNhN0JN_HjhNUjdhNU' !"MWdwIJN O Q p """"$ ha$  & F h$`a$ $ & F a$$a$VZTcMwfI K N O Q ^ h p ""褼~x~j\jNhBFCJKHaJmH sH hNCJKHaJmHsHhNCJKHaJmH sH  hN_HhN_HmHsH6hN5B*CJKH^J_HaJmH nHphsH tHhQ CJaJmH sH hECJaJmH sH hCJaJmH sH hNCJaJhVzoCJaJmH sH hFdCJaJmH sH hNCJaJmH sH hECJaJmH sH ""X#t#H$J$k$r$$$$$(%O%R%{%%%%%%"&%&L&O&x&&&&&&''4'7'`'c'''''''((*(-(U(X((((()=)\)_)hN^J_HhNH*^J_HmHsHhN^J_HmHsHhN5CJaJhN5CJaJmH sH hNOJQJ_HmHsHhNKH_HmHsHhNKH_HhN>*CJKHaJmH sH 8"t##$G$H$I$J$k$r$s$$$~~$G$IfHkd($$If0^K 44 la $$G$Ifa$_ $ h^a$ $ & F a$$ ha$ $$$$$$$cJkd<$$If0^K 44 la$G$IfJkd$$If0^K 44 la$$$$$$$cJkdF$$If0^K 44 la$G$IfJkd$$If0^K 44 la$$$$$$$cJkdP $$If0^K 44 la$G$IfJkd$$If0^K 44 la$$ % %%%%(%cJkdZ $$If0^K 44 la$G$IfJkd $$If0^K 44 la(%)%O%R%S%{%~%cJkdd $$If0^K 44 la$G$IfJkd $$If0^K 44 la~%%%%%%%cJkdn $$If0^K 44 la$G$IfJkd $$If0^K 44 la%%%%%%%cJkdx $$If0^K 44 la$G$IfJkd $$If0^K 44 la%%"&%&&&L&O&cJkd$$If0^K 44 la$G$IfJkd $$If0^K 44 laO&P&x&{&|&&&cJkd$$If0^K 44 la$G$IfJkd$$If0^K 44 la&&&&&&&cJkd$$If0^K 44 la$G$IfJkd$$If0^K 44 la&&&&&&&cJkd$$If0^K 44 la$G$IfJkd$$If0^K 44 la&&'''4'7'cJkd$$If0^K 44 la$G$IfJkd%$$If0^K 44 la7'8'`'c'd'''cJkd$$If0^K 44 la$G$IfJkd/$$If0^K 44 la'''''''cJkd$$If0^K 44 la$G$IfJkd9$$If0^K 44 la''(((*(-(cJkd$$If0^K 44 la$G$IfJkdC$$If0^K 44 la-(.(U(X(Y(((cJkd$$If0^K 44 la$G$IfJkdM$$If0^K 44 la(((((((cJkd$$If0^K 44 la$G$IfJkdW$$If0^K 44 la(((((((cJkd$$If0^K 44 la$G$IfJkda$$If0^K 44 la(() ) )#)&)ZJkd$$If0^K 44 la Y $$G$If$G$IfJkdk$$If0^K 44 la&)'):)=)>)\)_)cJkd$$If0^K 44 la$G$IfJkdu$$If0^K 44 la_)`)a))r****+B+?.@.E/F/00 ^` & F  _$ & F a$ & F $ & F ha$Jkd$$If0^K 44 la_)a)d)))9*=*r*s****+B+g+p+++$,%,},,,,"-(-F-O-t-y---?.@.//90?0000011111222556676G6|667798ϺϺϺϺϺϺϱϨϺϱϺϱՎϺhN>*KH_HmHsHhN6]_HmHsHhN5\_HhN6]_HhN_HmHsHhN>*_HmHsH hN_HhNOJQJ_HmHsHhNmHsHhN hNH*hNH*_HmHsH8012222244"5#5556676G677798:8Q88 $ & F a$ _$ & F a$$ & Fa$_$a$ $^`a$ $h^h`a$ $ & F a$98:8Q8889/999::o;z;|;};c<{<=>>>BGC}CCDDfHqHRIZIjJYKZK[K_KKKKKKK*L,L@MN߷߷߷߫tthWhWCJaJmH sH hWCJaJmH sH hECJaJmH sH hNCJOJQJaJmHsHhNCJaJmH sH hN_HmHsHhN_HmHsHhN6]_HhN>*_HmHsH hN_HhN>*KH_HmHsHhNOJQJ_HmHsH-8889999l:m:::A;B;|;};;;b<c<$ hh^h`a$$a$ w$^`a$  & F $ ha$ $ & F a$$ h^`a$c<{<==C=i=D>>>>>B B;CM@MMMNϘИۘ$a$ h^h`gdW $h^h`a$ $h^h`a$$a$ion 6.2, November 2005 [7] Understanding Platform LSF Job Exit Information, http://www.science-computing.de/manuals/lsf/7.0/reference/lsf_exit_code.html [8] Liberty Alliance http://www.libertyproject.org [9] OASIS http://www.oasis-open.org/home/index.php     GWD-E Krzysztof Kurowski, PaweB Lichocki, FedStage Systems Inc. Chris Smith, Platform Computing Inc. Distributed Resource Management Application API (DRMAA) Working Group September 29th, 2007 NИ ҚƛʛΛܛޛޠ(Сҡ֡ڡ ,.0268:տջɵտջh#0JOmHnHu hP0JOjhP0JOU h#_HhPh#_HmHsHhPCJaJmH sH  hP_HhP_HmHsHh jh U hL_H hN_HU&ۘ ܛޛ(*468:a$a$U$a$GWD-E Krzysztof Kurowski, PaweB Lichocki, FedStage Systems Inc. Chris Smith, Platform Computing Inc. Distributed Resource Management Application API (DRMAA) Working Group September 29th, 2007 drmaa-wg@gridforum.org  PAGE 3 /1h;0/ =!"#$% 2 01h;0/ =!"#$% 2 01h;0/ =!"#$% 2 01h;0/ =!"#$% /1h;0/ =!"#$% oDyK _toc54oDyK _toc77oDyK _toc94qDyK _toc363qDyK _toc364qDyK _toc383qDyK _toc389qDyK _toc396qDyK _toc409qDyK _toc411qDyK _toc418qDyK _toc423qDyK _toc426qDyK _toc433$$If!vh5K5 #vK#v :V 5K5 / / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / a$$If!vh5K5 #vK#v :V 5K5 / / / ah@h Normalny$*$1$A$a$+B*CJOJPJQJ^J_HaJmH sH tHf@f NagBwek 1/$ & Fx<@&]^`5KHV@V NagBwek 2'$ & F@&]^`^@^ NagBwek 3'$ & F@&]^`OJQJr@r NagBwek 4/$ & F<@&]^`5CJOJQJaJh@h NagBwek 5, & F<@&]^`56CJaJn@n NagBwek 6, & F<@&]^`5CJOJQJaJj@j NagBwek 7, & F<@&]^`CJOJQJaJn@n NagBwek 8, & F<@&]^`6CJOJQJaJb @b NagBwek 9, & F<@&]^`CJaJJA@J Domy[lna czcionka akapituTi@T  Standardowy :V 44 la ,k, Bez listy >O> WW8Num3z0CJOJQJ^JaJ>O> WW8Num3z1CJOJQJ^JaJ>O> WW8Num3z2CJOJQJ^JaJ>O!> WW8Num4z0CJOJQJ^JaJ>O1> WW8Num4z1CJOJQJ^JaJ>OA> WW8Num4z2CJOJQJ^JaJ2OQ2 WW8Num6z0OJQJ2Oa2 WW8Num6z1OJQJ2Oq2 WW8Num6z2OJQJ2O2 WW8Num7z0OJQJ2O2 WW8Num7z1OJQJ2O2 WW8Num7z2OJQJ2O2 WW8Num8z0OJQJ2O2 WW8Num8z1OJQJ2O2 WW8Num8z2OJQJ2O2 WW8Num9z0OJQJ2O2 WW8Num9z1OJQJ2O2 WW8Num9z2OJQJ4O4 WW8Num10z0OJQJ@O!@ WW8Num10z1CJOJQJ^JaJ@O1@ WW8Num10z2CJOJQJ^JaJ@OA@ WW8Num10z3CJOJQJ^JaJ4OQ4 WW8Num11z0OJQJ4Oa4 WW8Num11z1OJQJ4Oq4 WW8Num11z2OJQJ4O4 WW8Num12z0OJQJ4O4 WW8Num12z1OJQJ4O4 WW8Num12z2OJQJ4O4 WW8Num13z0OJQJ4O4 WW8Num13z1OJQJ4O4 WW8Num13z2OJQJ4O4 WW8Num14z0OJQJ@O@ WW8Num14z1CJOJQJ^JaJ@O@ WW8Num14z2CJOJQJ^JaJ@O@ WW8Num14z3CJOJQJ^JaJ4O!4 WW8Num15z0OJQJ4O14 WW8Num15z1OJQJ4OA4 WW8Num15z2OJQJLOQL Domy[lna czcionka akapitu1JOaJ Absatz-StandardschriftartPOqP WW-Absatz-Standardschriftart2O2 WW8Num5z0OJQJ4O4 WW8Num16z0OJQJ4O4 WW8Num16z1OJQJ4O4 WW8Num16z2OJQJ4O4 WW8Num18z0OJQJ4O4 WW8Num18z1OJQJ4O4 WW8Num18z2OJQJ8O8 WW8Num19z0 OJQJPJ4O4 WW8Num19z1OJQJ4O4 WW8Num19z2OJQJ4O!4 WW8Num19z3OJQJ8O18 WW8Num20z0 OJQJPJ4OA4 WW8Num20z1OJQJ4OQ4 WW8Num20z2OJQJ4Oa4 WW8Num20z3OJQJ4Oq4 WW8Num25z0OJQJ4O4 WW8Num25z1OJQJ4O4 WW8Num25z2OJQJ4O4 WW8Num28z0OJQJ4O4 WW8Num28z1OJQJ4O4 WW8Num28z2OJQJPOP WW-Domy[lna czcionka akapitu8U@8 HiperBcze B*ph>*0)@0 Numer stronyBV@B U|yteHiperBcze B* ph>*POP OdwoBanie do komentarza1CJaJ>O!> BulletsCJOJPJQJ^JaJ6O16 Znaki numeracjiZOAZ Symbole wypunktowaniaCJOJPJQJ^JaJ:Ob: NagBwek1 U !DB@bD Tekst podstawowy Vx>/@r> ListaWh]^h`BOB Podpis1X]^`,O, IndeksY $P@bP NagBwek Zx$CJOJPJQJ^JaJB@@B Podpis [xx $6CJ]aJNObN Heading \x$CJOJ PJ QJ ^J aJFOF Legenda1 ]xx $6CJ]aJ*O* Index^ $.O. nobreak_$dOd HTML Body `1$*$7$+B*CJOJ PJQJ ^J_HaJmH sH tH4 @4 Stopka a !`O"` Tekst blokowy1bh]^h`CJOJQJaJ<O< WW-Legenda cxx5H^@BH Normalny (Web)dCJOJQJaJVORV ZwykBy tekst1e]^`OJQJjC@bj Tekst podstawowy wcity"fhx]^h`ROrR Tekst podstawowy 31 gxCJaJlOal Tekst podstawowy z wciciem1h]^`pOap Tekst podstawowy z wciciem 21ih]^h`vOv Tekst podstawowy wcity 21(jhdx]^h`xOx Tekst podstawowy wcity 31"khx]^h`CJaJVOV Zwrot po|egnalny1l]^`>O> Tekst komentarza1m&O& Data1nTOT Plan dokumentu1o-D(M OJ QJ 6[@6 Podpis e-mailpL+L Tekst przypisu koDcowegoq^$@"^ Adres na kopercier@ ]^@ `CJaJN%@2N Adres zwrotny na koperciesHBH Tekst przypisu dolnegot8`@R8 HTML - adresu6\e@b\ HTML - wstpnie sformatowanyvOJQJD @D Indeks 1w8]^`8D D Indeks 2x8]^`8D D Indeks 3yX8]^X`8FOF Indeks 41z 8]^ `8FOF Indeks 51{8]^`8FOF Indeks 61|8]^`8FOF Indeks 71}x8]^x`8FOF Indeks 81~@8]^@`8FOF Indeks 918]^`8@!r@ NagBwek indeksu5DOD Lista 21]^`DO"D Lista 318]^8`DO2D Lista 41]^`DOBD Lista 51]^`VORV Lista punktowana1]^`ZObZ Lista punktowana 21]^`ZOrZ Lista punktowana 31]^`ZOZ Lista punktowana 41]^`ZOZ Lista punktowana 51]^`dOd Lista - kontynuacja1"hx]^h`hOh Lista - kontynuacja 21"x]^`hOh Lista - kontynuacja 31"8x]^8`hOh Lista - kontynuacja 41"x]^`hOh Lista - kontynuacja 51"x]^`VOV Lista numerowana1]^`ZO Z Lista numerowana 21]^`ZO Z Lista numerowana 31]^`ZO" Z Lista numerowana 41]^`ZO2 Z Lista numerowana 51]^`OB Tekst makra1(1$  ` @ *$+B*CJOJPJQJ^J_HaJmH sH tHOR NagBwek wiadomo[ci1C8$d%d&d'd-DM ]^8`CJaJVOb V Wcicie normalne1]^`>O> NagBwek notatki1FOF Zwrot grzeczno[ciowy1BJ@bB PodtytuB$<a$CJaJNON Wykaz zrdeB18]^`8TOT Spis ilustracji1p]^`pD>@ D TytuB$<a$5CJ KHaJ ^O^ NagBwek wykazu zrdeB1 x 5CJaJ6@6  Spis tre[ci 1N@N  Spis tre[ci 2]^`NN  Spis tre[ci 3]^`NN  Spis tre[ci 4X]^X`NN  Spis tre[ci 5 ]^ `NN  Spis tre[ci 6]^`NN  Spis tre[ci 7]^`NN  Spis tre[ci 8x]^x`NN  Spis tre[ci 9@]^@`DOr D Tekst dymka1CJOJ QJ aJBOB Temat komentarza15lO l WW-Default 1$*$7$1B*CJOJPJQJ^J_HaJmHphsHtHRO R Contents 10" &  ]^ `XO X Spis tre[ci 10" %  ]^ `fO f Default 1$*$7$1B*CJOJPJQJ^J_HaJmHphsHtH@O @ Zawarto[ tabeli $JO J NagBwek tabeli $ $a$5\HO H Tekst podstawowy 21$a$B@ B Tekst dymkaCJOJQJaJ<j@< Temat komentarza @D1eͤ@DTUmnWX2^"#[\fg(.BBBB CAD!v:!v:!v:!v:!v:!v:!v:!v:!v:!v:![![![![!Y!v:!v:!v:!v:!v:!v:!v:![!Y!Y!Y!v:!v:!v:!v:!v:!v:!v:!v:!v:TUmnWX2^"#[\fg(  D C x L  +@RSij$VWX`(k&'589GJK^bcw{|/23CFG\_`,/0?CDX\]twx?BCilm   8;<QTUtwx& ##$$&&''((****+++++5-6-A---._.`.m.//// 0!0p0q00001111122/22223?3d3e3f33<6=6X7Y7d788899 < <<<<>>v?w?x???2@3@4@@@@@4A5AkAAAAAAA!B"B$B%B'B(B*B+B-B.BBBB C"C#CCCCDDDD=D>DAD0000000000 0 0 0 0 00000000 0 0 0 00000000000000000000000 00 0 0 0 0  0  0  0  0  0 0 0 0 0 0 0 0 0  000000 0 0 000_00 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Y0 0 0 0 0 0 0 0 0 0 0 00000 00  _0 0  0 0  0 0  0 0  0 0  0 0  0 0  0 0  0 _0 0  _0+_0+_0+ 0+_0+0  0-0-0- 0-0-0- 0w0/0/ 0/0/ 0/0/ 0/0/ 0/0/ 0/0/ 002 0020202020202 00f30f30f30f3 00Y70Y7 0080808080808 0 0000000000000000000000000y0y0y0y0y0y0y0y0@U0@0@0@0@U0y0@U0@0@0@0@U0@U0y0 @a0y0y0<>>v?w?x??A!BAD{0đy0y0y0y0{0{0 iDV"_)98N:'+,./FHN "$$$$(%~%%%O&&&&7'''-((((&)_)08c<qHۘ:(*-0123456789:;<=>?@ABCDEGIJKO8)    B D ^ ' A C ] v x  : J L f @D XXXXXXXXXXXXXX!_toc54 _Ref525097868_toc77_toc94_toc363_toc364_toc383_toc389_toc396_toc409_toc411_toc418_toc423_toc426_toc433  +-/22f3Y78<AD   +-/22f3Y78<AD LNG$"oGIJ$$D$TEEE,,==AAAAD      ,,==AAAAD C*urn:schemas-microsoft-com:office:smarttagsmetricconverter9 *urn:schemas-microsoft-com:office:smarttagsplaceB *urn:schemas-microsoft-com:office:smarttagscountry-region8*urn:schemas-microsoft-com:office:smarttagsCity (o1.0 C ProductID     DJLO,39AFIJPQY\e(0NVBM W [ ^e ~ "SZ-4ov{;D]b #(/RW^ckq'39EK\cu|3AGZ0>DV]rx<Ox !$!x!!!!(","-"0"1":"J"Q"h"k""""#(#-#$$9%C%|%%%%%%F&J&M&''))c)i)t)x)c*k***++0,6,,,,,:-@--------.`.e.f.l.s.y......./ /5/:/X/a/y/}/~////////#1.1 2.2222222 3333#3+3-35363=3U3^3_3b3f3r3s3{3|337 7!7(7)7,7-787<7?7D7M7N7V7Y7c7778888<<o=w=>>>>>>>>>>>>>?|??8@>@?@F@H@M@N@X@d@l@n@s@t@|@!B"B"B$B$B%B%B'B(B*B+B-B.B3B}BBBBBBBBCC#C(CrCzC|CCCCCCD D DD2DDAD#D|   "A#w#}#&*&))//==?E?!B"B"B$B$B%B%B'B(B*B+B-B.BGBCC#CDAD333333333333333"B"B$B$B%B%B'B(B*B+B-B.B>DAD^`.^`.^`..^`... ^` .... ^` ..... ^` ...... ^`....... ^`........^`.^`.^`.^`.^`.^`.^`.^`.^`.^`OJQJ^`OJQJ^`OJQJ^`OJQJWW8Num2WW8Num9WW8Num11WW8Num13WW8Num15NSQ #h.s5FdVzoEP(LW NPEBF&'589GJK^bcw{|/23CFG\_`,/0?CDX\]twx?BCilm   8;<QTUtwxAD@p 34@A4B#C@D@@@@(@@>@@@L@0@@@Unknown Gz Times New Roman5Symbol3& z Arial;& z Helvetica;Wingdings_ StarSymbolArial Unicode MS?Wingdings 2[Lucida GrandeCourier New?5 z Courier NewO&Nimbus Sans LArial?DejaVu SansCFComic Sans MS5& zaTahomaBhEʶ&FQ  r 8!xr 8!x!4BBHP?s5Title of DocumentxxxKikas$      Oh+'0h1   , 8 D P\dlt|Title of DocumentxxxNormalKikas17Microsoft Office Word@hx@00UQ>@v)%@:z9r 8G/VT$m     .@"Arial- 2  GWD ) 2  - 2  E2 i Krzysztof Kurowski, Pawe Lichocki, FedStage Systems Inc.           $   'A2 $ Chris Smith, Platform Computing Inc.  $     # $   2   ' 2  S2 Iv0 Distributed Resource Management Application API       #$     2 I, ,2 yv (DRMAA) Working Group # )   2 yX  2 w  2  2   September  $ 2  292  th 2   , 2007  2   '@Times New Roman- 2 v @"Arial-A2 v$ FedStage Grid Application Framework  !     %! 2 w -82  LSF DRMAA 1.0 Implementation  #   % %  2  Report 2  (Ver. 6   2 ( ) 2 6 - 2 9v @ Arial--.2 iv Status of This Document      $ - @ !mv- 2 i?  2 v 2 vW This document provides information to the Grid community about the adoption of the OGF  $     $   ! #$       ! %2 v specification GFDc    2  - 2  R 2  -F2 ' P.022 in the Platform LSF workload mana      $ $22 0 gement system, Open DRMAA $  # !# e2 )v< Service Provider (OpenDSP) and FedStage Computing Provider.      !    $    2 )0 - 2 Wv -2 v[ It does not define any standards or technical recommendations. Distribution is unlimited.           #$         #  2   2 v -"2 v List of Changes   - @ !!v- 2  @Symbol-@"Arial--- 2  - 2  (-J2  * Integrations status (between OpenDSP and          !  2 D Platform   #2   LSF) (po  2  int 1)   2   '- 2 N - 2 N (-J2 N * Extension of testing description (point 2)            2 N  '- 2  - 2  (-L2  + Updated statuses of library tests (point 2)             2   '- 2  - 2  (-n2  B Updated known issues about current implementation (entire point 3)      $ $        2   '- 2  - 2  (-12   Major changes in point 3 #     2  b2 : updates to implentations comments take into account the    #    #$        '2    feedback fr  "2  om Platform LSF$    #  2   ' 2 Fv -#2 vv Copyright Notice   - @ !5zv- 2 v  2 v @2 v# Copyright Open Grid Forum 2007. m   ! !  $  )2 . All Rights Reserved.     2   2 v -2 5v  Trademark$ - @ !9v- 2 5@  2 ev - 2  - 2  (-2  O Open Grid Services Architecture and OGSA are trademarks of the Open Grid Forum.! !         !!  #   ! !  $ 2 )  '- 2  - 2  (-y2  I LSF is a registered trademark of Platform Computing Corporation in the UnF    $    $$    2   ited States     '42   and in other jurisdictions.o        2   '- 2 - - 2 - (-h2 - > FedStage is a registered trademark of FedStage Systems Company     $   $$&2 - in European Union   2 -  '42 ]  and in other jurisdictions.o        2 ]  '- 2  - 2  (-2  S UNIX is a registered trademark of The Open Group in the United States and in other O     $ !!         ' 2   jurisdictions.     2   ' 2 v  '-2 8v Abstract 2 8 -m2 uvA This document describes experiences in the implementation of the  $      $ $    2 u  Distributed    2 u  Resource  2 v[ Management Application API (DRMAA) specification for the Platform LSF workload management, #$     #         $    $$ 2 vN Open DRMAA Service Provider (OpenDSP) and FedStage Computing Provider. The doc!#    ! $   2   ument $ @"Arial--2  vO reports about issues that where identified during implementation and test of a          $ $     -%2  S Grid Application n!    -2 4 v  Framework # 2 4 W - 2 4 e LSF DRMAA 1.0# -n2 4 B library for Platform LSF, which was evaluated successfully with      $        j2 e v? the DRMAA working group compliance test for C bindings. Suggest # $        52 e t ions for improvement of the   $$    ^2 v7 specification, mainly concerning readability of the GFD   $        2  - 2  R 2  ->2 " P.022 specification document were    $  =2 v! given in [4] and are not part of          2  this  2   document. $ 2   2 v @"Arial-"Systemq_!-                            ՜.+,D՜.+, hp  a South Hellx!B Title of Document Abstract IntroductionPlatform LSF experience reportBGrid Application Framework - LSF DRMAA 1.0 implementation issues Job attributes comments Job exit status Multi threaded versionFurther developmentSecurity Considerations Contributors Intellectual Property Statement DisclaimerFull Copyright Notice References Tytu Nagwki X# /G c _PID_HLINKS ggf-doc-nameggf-doc-revision-dateggf-doc-versionggf-group-mailggf-doc-version-dateggf-group-name ggf-gwd-typeAT$)_toc433%&_toc426%#_toc423& _toc418&_toc411'_toc409._toc396/_toc389/_toc383!_toc364! _toc363 #_toc94 _toc77#_toc54document name 001example@ggf.org1 January 1970WG or RG or CG nameGWD-R, GWD-I or GWD-C  !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRTUVWXYZ[\]^_`acdefghijklmnopqrstuvwxyz{|}~Root Entry FN9Data S1Tableb+WordDocumentSummaryInformation(1DocumentSummaryInformation8CompObjz  F(Dokument programu Microsoft Office Word MSWordDocWord.Document.89q