Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,061 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

11061 Commits

Author SHA1 Message Date
Karthik Kambatla bd69ea408f YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha) 2015-06-07 11:37:52 -07:00
Xiaoyu Yao b61b489995 HDFS-8116. Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager. Contributed by Brahma Reddy Battula. 2015-06-06 18:47:45 -07:00
cnauroth 71de367c5e HDFS-8432. Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Contributed by Chris Nauroth. 2015-06-06 09:43:47 -07:00
cnauroth e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Jason Lowe b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Xiaoyu Yao 3841d09765 HDFS-8522. Change heavily recorded NN logs from INFO to DEBUG level. (Contributed by Xiaoyu Yao) 2015-06-05 15:09:24 -07:00
Andrew Wang bc11e158b1 HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 2015-06-05 13:52:21 -07:00
Andrew Wang 2dbc40e608 HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 2015-06-05 13:11:01 -07:00
Xuan 3e000a919f YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong 2015-06-05 12:48:52 -07:00
Karthik Kambatla 75885852cc YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha) 2015-06-05 09:39:41 -07:00
Karthik Kambatla 6786daab33 MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha) 2015-06-05 09:14:06 -07:00
Devaraj K 09b8241e6e MAPREDUCE-6383. Pi job (QuasiMonteCarlo) should not try to read the 
results file if its job fails. Contributed by Harsh J.
 2015-06-05 21:22:47 +05:30
Devaraj K 790a861766 MAPREDUCE-6377. JHS sorting on state column not working in webUi. 
Contributed by zhihai xu.
 2015-06-05 15:50:16 +05:30
Andrew Wang b2540f486e HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. 2015-06-04 15:35:07 -07:00
Zhijie Shen 18dd01d6bf YARN-3766. Fixed the apps table column error of generic history web UI. Contributed by Xuan Gong. 2015-06-04 14:47:08 -07:00
Wangda Tan 405bbcf68c Add missing test file of YARN-3733 2015-06-04 13:18:44 -07:00
Gera Shegalov 9f6d67844d HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 2015-06-04 11:38:28 -07:00
Jian He 1970ca7cbc YARN-2392. Add more diags about app retry limits on AM failures. Contributed by Steve Loughran 2015-06-04 11:14:09 -07:00
Andrew Wang 5149dc7b97 HDFS-8532. Make the visibility of DFSOutputStream#streamer member variable to private. Contributed by Rakesh R. 2015-06-04 11:09:19 -07:00
Arpit Agarwal 8266dae0e9 HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. (Contributed by Kengo Seki) 2015-06-04 10:54:18 -07:00
Jian He 6ad4e59cfc YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan 2015-06-04 10:52:59 -07:00
Kihwal Lee ade6d9a61e HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. 2015-06-04 12:51:00 -05:00
Wangda Tan ebd797c48f YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda) 2015-06-04 10:22:57 -07:00
Akira Ajisaka dbed757cba HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 2015-06-05 01:45:34 +09:00
Junping Du d7e7f6aa03 YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K. 2015-06-04 04:59:27 -07:00
Gera Shegalov e8302071ff MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera) 2015-06-03 23:46:06 -07:00
Vinayakumar B 1bb79c9d01 HADOOP-12019. update BUILDING.txt to include python for 'mvn site' in windows (Contributed by Vinayakumar B) 2015-06-04 10:42:52 +05:30
Akira Ajisaka b5f0d294f8 HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files and is created by 'git diff --no-prefix'. Contributed by Kengo Seki. 2015-06-04 11:14:55 +09:00
Robert Kanter cc70df98e7 MAPREDUCE-5965. Hadoop streaming throws error if list of input files is high. Error is: "error=7, Argument list too long at if number of input file is high" (wilfreds via rkanter) 2015-06-03 18:41:45 -07:00
Xuan 5766a04428 YARN-3749. We should make a copy of configuration when init 
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
 2015-06-03 17:20:15 -07:00
Gera Shegalov d90c13e2da MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera) 2015-06-03 16:50:26 -07:00
Zhijie Shen bc85959edd Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong." 
This reverts commit 4a9ec1a824.
 2015-06-03 14:15:56 -07:00
Zhijie Shen 4eec2fd132 Revert "YARN-1462. Correct fix version from branch-2.7.1 to branch-2.8 in" 
This reverts commit 0b5cfacde6.
 2015-06-03 14:15:56 -07:00
Karthik Kambatla edb9cd0f7a YARN-3762. FairScheduler: CME on FSParentQueue#getQueueUserAclInfo. (kasha) 2015-06-03 13:47:24 -07:00
Jason Lowe 107da29ff9 MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li 2015-06-03 20:19:27 +00:00
Jason Lowe e13b671aa5 YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks 2015-06-03 19:44:07 +00:00
Zhijie Shen dbc4f64937 YARN-3751. Fixed AppInfo to check if used resources are null. Contributed by Sunil G. 2015-06-03 11:51:41 -07:00
Vinayakumar B c59e745630 HDFS-3716. Purger should remove stale fsimage ckpt files (Contributed by J.Andreina) 2015-06-03 15:30:40 +05:30
Vinayakumar B 444a4510c8 HDFS-8523. Remove usage information on unsupported operation 'fsck -showprogress' from branch-2 (Contributed by J.Andreina) 
Merged CHANGES.txt from branch-2.7

(cherry picked from commit 0ed9c2d8fe)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md

(cherry picked from commit dd98cfd328)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
 2015-06-03 15:20:42 +05:30
Vinayakumar B e965dcec37 HDFS-8470. fsimage loading progress should update inode, delegation token and cache pool count. (Contributed by surendra singh lilhore) 2015-06-03 14:24:55 +05:30
Vinayakumar B 54f83d9bd9 HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 2015-06-03 12:11:46 +05:30
Akira Ajisaka a6a8ee3c24 HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh is modified. Contributed by Kengo Seki. 2015-06-03 15:01:02 +09:00
Colin Patrick Mccabe 806e407ac8 HDFS-8521. Add VisibleForTesting annotation to BlockPoolSlice#selectReplicaToDelete. (cmccabe) 2015-06-02 20:06:28 -07:00
Andrew Wang c1d50a91f7 HDFS-8513. Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant. (wang) 2015-06-02 15:48:26 -07:00
Andrew Wang efc510a570 HDFS-8386. Improve synchronization of 'streamer' reference in DFSOutputStream. Contributed by Rakesh R. 2015-06-02 15:39:24 -07:00
Colin Patrick Mccabe 03fb5c6425 HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) 2015-06-02 11:40:37 -07:00
Vinayakumar B a2bd6217eb HDFS-8256. '-storagepolicies , -blockId ,-replicaDetails ' options are missed out in usage and from documentation (Contributed by J.Andreina) 2015-06-02 16:07:18 +05:30
Andrew Wang 990078b927 HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth documentation. Contributed by Masatake Iwasaki. 2015-06-01 18:04:52 -07:00
Jing Zhao cdc13efb1a HDFS-8489. Subclass BlockInfo to represent contiguous blocks. Contributed by Zhe Zhang. 2015-06-01 11:42:58 -07:00
Xuan 0b5cfacde6 YARN-1462. Correct fix version from branch-2.7.1 to branch-2.8 in 
CHANGES.txt
 2015-06-01 11:39:00 -07:00