Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,834 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

1834 Commits

Author SHA1 Message Date
Siddharth Seth 03d46dc571 MAPREDUCE-3569. TaskAttemptListener holds a global lock for all task-updates. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227485 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 05:19:44 +00:00
Arun Murthy 08f8abf563 MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for performance reasons. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227426 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:37:13 +00:00
Eli Collins 85c4158074 HADOOP-7949. Updated maxIdleTime default in the code to match core-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227423 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:31:14 +00:00
Arun Murthy 0870734787 MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227422 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:29:52 +00:00
Mahadev Konar e793ba8cba MAPREDUCE-3478. Cannot build against ZooKeeper 3.4.0. (Tom White via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227408 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 00:13:39 +00:00
Siddharth Seth be285fc27f MAPREDUCE-3595. Add missing TestCounters#testCounterValue test from branch 1 to 0.23 (Contributed by Tom White) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227380 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 23:15:41 +00:00
Siddharth Seth f445eb31f1 MAPREDUCE-3529. TokenCache does not cache viewfs credentials correctly. (sseth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227374 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 23:07:27 +00:00
Alejandro Abdelnur c27de4bd0b MAPREDUCE-1744. DistributedCache creates its own FileSytem instance when adding a file/archive to the path. (Dick King via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227238 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 17:51:17 +00:00
Vinod Kumar Vavilapalli 55e94dc5ef MAPREDUCE-3490. Fixed MapReduce AM to count failed maps also towards Reduce ramp up. Contributed by Sharad Agarwal and Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227226 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 17:10:31 +00:00
Alejandro Abdelnur 1447274693 HADOOP-7948. Shell scripts created by hadoop-dist/pom.xml to build tar do not properly propagate failure. (cim_michajlomatijkiw via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227225 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 16:56:01 +00:00
Harsh J 075122690c HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 14:15:15 +00:00
Harsh J 2f19c59f1d MAPREDUCE-3610. Remove use of the 'dfs.block.size' config for default block size fetching. Use FS#getDefaultBlocksize instead. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227091 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 09:39:14 +00:00
Amar Kamat 4c0bac5670 MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227051 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 05:38:17 +00:00
Siddharth Seth 7ee3e072b8 HADOOP-7933. Add a getDelegationTokens api to FileSystem which checks for known tokens in the passed Credentials object. (sseth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226916 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 18:58:57 +00:00
Harsh J 05ed36cd52 HDFS-2722. HttpFs should not be using an int for block size. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 16:47:49 +00:00
Harsh J 5f15c292dc HADOOP-7504. Add the missing Ganglia31 opts to hadoop-metrics.properties as a comment. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226351 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-02 06:30:20 +00:00
Harsh J 36a2d57f07 HADOOP-7919. Remove the unused hadoop.logfile.* properties from the core-default.xml file. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226350 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-02 06:26:40 +00:00
Harsh J 8e8203f3c5 HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226239 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-01 12:06:49 +00:00
Harsh J 11905517f1 HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226211 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-01 03:11:48 +00:00
Arun Murthy 4ab6ae543e MAPREDUCE-3608. Fixed compile issue with MAPREDUCE-3522. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225726 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-30 02:24:14 +00:00
Arun Murthy 743a5b78e3 MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't explicitly specified. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225618 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 19:06:34 +00:00
Harsh J 6c349f9420 HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225591 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 16:51:59 +00:00
Harsh J 07027b80f3 HADOOP-7910. Add Configuration.getLongBytes to handle human readable byte size values. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225489 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 10:27:14 +00:00
Arun Murthy 7afb9aca70 MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225471 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 08:24:09 +00:00
Arun Murthy f025652fda MAPREDUCE-3547. Added a bunch of unit tests for the the RM/NM webservices. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225463 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 08:06:04 +00:00
Harsh J 41737432c0 HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225456 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 07:22:54 +00:00
Arun Murthy 919f56c3d4 MAPREDUCE-3604. Fixed streaming to use new mapreduce.framework.name to check for local mode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225259 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 18:23:12 +00:00
Harsh J 1e0c51c66e HADOOP-7348. Change 'addnl' in getmerge util to be a flag '-nl' instead (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225192 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 14:30:19 +00:00
Harsh J a9ffbdd0d7 MAPREDUCE-2944. Improve checking of input for JobClient.displayTasks() (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225188 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 14:11:02 +00:00
Harsh J 9eb87574a3 HADOOP-7574. Improve FSShell -stat, add user/group elements (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225114 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 06:48:31 +00:00
Vinod Kumar Vavilapalli fcbad14a3d MAPREDUCE-3568. Optimized Job's progress calculations in MR AM. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224995 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 19:54:51 +00:00
Vinod Kumar Vavilapalli cd90b82227 MAPREDUCE-3399. Modifying ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224970 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 18:26:21 +00:00
Alejandro Abdelnur ae0d48854d HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-26 19:37:25 +00:00
Amar Kamat 1dcc4b57ee MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the job-history related information. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1222695 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-23 14:47:23 +00:00
Siddharth Seth 8fa0a3c737 MAPREDUCE-3567. Extraneous JobConf objects in AM heap. Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1222498 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 22:34:40 +00:00
Vinod Kumar Vavilapalli ef9b974879 MAPREDUCE-3586. Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221950 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 23:47:54 +00:00
Mahadev Konar 55ad01711e HADOOP-7890. Redirect hadoop script's deprecation message to stderr. (Koji Knoguchi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221849 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 19:34:09 +00:00
Alejandro Abdelnur 6b4f40cbf9 HttpFS server should check that upload requests have correct content-type. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221616 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 05:26:20 +00:00
Alejandro Abdelnur 8fe3dd3fea HDFS-2657. TestHttpFSServer and TestServerWebApp are failing on trunk. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221580 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 03:03:16 +00:00
Amar Kamat 264d3b7dd0 MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks. (Devaraj K and Amar Kamat via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221578 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 02:58:00 +00:00
Alejandro Abdelnur 45620eee68 HDFS-2646. Hadoop HttpFS introduced 4 findbug warnings. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221572 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 02:46:04 +00:00
Vinod Kumar Vavilapalli 8626f1bc6c MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221533 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 00:06:06 +00:00
Vinod Kumar Vavilapalli e7543b944c MAPREDUCE-3339. Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221523 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 23:27:02 +00:00
Vinod Kumar Vavilapalli 4e1d5a0d71 MAPREDUCE-3391. Making a trivial change to correct a log message in DistributedShell app's AM. Contributed by Subroto Sanyal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221516 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 23:13:15 +00:00
Arun Murthy 96247ead03 MAPREDUCE-3376. Fixed Task to ensure it passes reporter to combiners using old MR api. Contributed by Subroto Sanyal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221501 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 22:01:13 +00:00
Eli Collins f9b2197d2a HADOOP-7837. no NullAppender in the log4j config. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221348 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 17:17:26 +00:00
Tsz-wo Sze 3503d9a4a8 HDFS-2706. Use configuration for blockInvalidateLimit if it is set. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221106 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 05:49:24 +00:00
Arun Murthy a61a18cc09 MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220996 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 23:07:17 +00:00
Todd Lipcon dfba847eb6 Amend HDFS-234 (bkjournal contrib). Fix findbugs build 
- Fixes pom parent to point to hadoop-project instead of hadoop-project-dist
- Fix relative path in pom to have the correct number of ../s


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220940 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 20:42:25 +00:00
Alejandro Abdelnur de928a4aa0 HDFS-2658. HttpFS introduced 70 javadoc warnings. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220810 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 15:53:53 +00:00