Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,990 Commits 326 Branches 371 Tags
Commit Graph

8990 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cnauroth
524593ee84 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 
(cherry picked from commit 80935268f5fdd358070c6b68f89e8bd699785c54)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-04-24 13:08:47 -07:00
Jian He
0583c27fb1 YARN-3387. Previous AM's container completed status couldn't pass to current AM if AM and RM restarted during the same time. Contributed by Sandflee 
(cherry picked from commit d03dcb9635dbd79a45d229d1cab5fd28e5e49f49)
 2015-04-24 12:14:17 -07:00
Andrew Wang
89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 
(cherry picked from commit c7d9ad68e34c7f8b9efada6cfbf7d5474cbeff11)
 2015-04-24 11:54:48 -07:00
Jing Zhao
5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 
(cherry picked from commit cf6c8a1b4ee70dd45c2e42ac61999e61a05db035)
 2015-04-24 10:24:12 -07:00
Xuan
c184466939 YARN-3511. Add errors and warnings page to ATS. Contributed by Varun Vasudev 
(cherry picked from commit eee9facbbae52cb62dfca01b8bbe676b8e289863)
 2015-04-24 09:43:35 -07:00
Vinayakumar B
2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 
(cherry picked from commit c8d72907ff5a4cb9ce1effca8ad9b69689d11d1d)
 2015-04-24 12:51:56 +05:30
Vinayakumar B
68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 
(cherry picked from commit 262c1bc3398ce2ede03f9d86fc97c35ca7a8e9db)
 2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe
3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 
(cherry picked from commit a8898445dc9b5cdb7230e2e23a57393c9f378ff0)
 2015-04-23 19:15:33 -07:00
Colin Patrick Mccabe
788b76761d HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 
(cherry picked from commit a0e0a63209b5eb17dca5cc503be36aa52defeabd)
 2015-04-23 19:08:20 -07:00
Haohui Mai
b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00
Xuan
8f6053ae51 YARN-3516. killing ContainerLocalizer action doesn't take effect when 
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu

(cherry picked from commit 0b3f8957a87ada1a275c9904b211fdbdcefafb02)
 2015-04-23 16:41:52 -07:00
Tsz-Wo Nicholas Sze
f27a976a2f HDFS-8215. Refactor NamenodeFsck#check method. Contributed by Takanobu Asanuma 2015-04-23 14:23:02 -07:00
Steve Loughran
a6a5d1d6b5 HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) 2015-04-23 21:39:43 +01:00
cnauroth
d1253f695d HADOOP-11872. "hadoop dfs" command prints message about using "yarn jar" on Windows(branch-2 only). Contributed by Varun Vasudev. 2015-04-23 13:10:39 -07:00
Tsz-Wo Nicholas Sze
d6c8609663 HDFS-8147. StorageGroup in Dispatcher should override equals nad hashCode. Contributed by surendra singh lilhore 2015-04-23 11:56:09 -07:00
Vinod Kumar Vavilapalli
0ec6e7e7f5 YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv) 
(cherry picked from commit f5fe35e297ed4a00a1ba93d090207ef67cebcc9d)
 2015-04-23 11:25:30 -07:00
Jian He
48d8d88245 YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen 
(cherry picked from commit aa4a192feb8939353254d058c5f81bddbd0335c0)
 2015-04-23 11:07:54 -07:00
Wangda Tan
9692bcc2c8 YARN-3319. Implement a FairOrderingPolicy. (Craig Welch via wangda) 
(cherry picked from commit 395205444e8a9ae6fc86f0a441e98486a775511a)
 2015-04-23 10:48:00 -07:00
Arpit Agarwal
edbeefdb05 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 2015-04-23 09:35:15 -07:00
tgraves
1cd2fcf25d YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation 
(cherry picked from commit 189a63a719c63b67a1783a280bfc2f72dcb55277)
 2015-04-23 14:49:24 +00:00
Arun Suresh
889b92fa40 HDFS-4448. Allow HA NN to start in secure mode with wildcard address configured (atm via asuresh) 
(cherry picked from commit baf8bc6c488de170d2caf76d9fa4c99faaa8f1a6)
 2015-04-23 01:45:33 -07:00
Steve Loughran
63ccb9167e YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel) 2015-04-23 09:22:23 +01:00
Steve Loughran
4f9b24b90a HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. (Larry McCay via stevel) 2015-04-23 09:06:02 +01:00
cnauroth
4054db5098 HADOOP-11861. test-patch.sh rewrite addendum patch. Contributed by Allen Wittenauer. 
(cherry picked from commit 18eb5e79345295b2259b566c154375ad2a6216a1)
 2015-04-22 22:23:46 -07:00
Vinod Kumar Vavilapalli
04783b0402 YARN-3366. Enhanced NodeManager to support classifying/shaping outgoing network bandwidth traffic originating from YARN containers Contributed by Sidharta Seethana. 
(cherry picked from commit a100be685cc4521e9949589948219231aa5d2733)
 2015-04-22 17:36:55 -07:00
Jason Lowe
feb995fc50 HADOOP-11868. Invalid user logins trigger large backtraces in server log. Contributed by Chang Li 
(cherry picked from commit 0ebe84d30af2046775884c9fb1e054da31582657)
 2015-04-22 20:57:46 +00:00
Colin Patrick Mccabe
72b706a1b0 HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c (Malcolm Kavalsky via Colin P. McCabe) 
(cherry picked from commit a3b1d8c90288a6237089a98d4a81c25f44aedb2c)
 2015-04-22 12:41:07 -07:00
Haohui Mai
71c9f2f4e7 HDFS-8218. Move classes that used by ClientProtocol into hdfs-client. Contributed by Haohui Mai. 2015-04-22 11:33:32 -07:00
Tsuyoshi Ozawa
a479669e96 Fix a misleading summary of MAPREDUCE-6330 in CHANGES.txt. 
(cherry picked from commit 252e69f562383383cf539b29f1da68676b7ce0c0)
 2015-04-23 03:28:46 +09:00
Tsuyoshi Ozawa
542d53a268 MAPREDUCE-6330. Fix typo in some Task Attempt API's URL. Contributed by Ryu Kobayashi. 
(cherry picked from commit e33594dd87f83953b59b7416c82992de760eb4cd)
 2015-04-23 03:22:02 +09:00
Jitendra Pandey
db4419df6b HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman. 2015-04-22 10:02:02 -07:00
Junping Du
8de6045842 New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K 
(cherry picked from commit fad9d7e85b1ba0934ab592daa9d3c9550b2bb501)
 2015-04-22 10:08:16 -07:00
Akira Ajisaka
f469f9af2d YARN-3410. Addendum fix for compilation error. Contributed by Rohith. 
(cherry picked from commit b08908ae5eaf60a7fc70bf60493a533e915553c5)
 2015-04-22 17:48:55 +09:00
Haohui Mai
f02ca4ab15 HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai. 2015-04-21 22:09:13 -07:00
Jian He
613a783380 YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev 
(cherry picked from commit 674c7ef64916fabbe59c8d6cdd50ca19cf7ddb7c)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
 2015-04-21 21:06:06 -07:00
Jian He
dc4698bb33 YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks 
(cherry picked from commit bdd90110e6904b59746812d9a093924a65e72280)
 2015-04-21 20:34:30 -07:00
Wangda Tan
8a9599fb9e YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda) 2015-04-21 17:47:27 -07:00
Ravi Prakash
aa34aa5caa HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:50:40 -07:00
Steve Loughran
6d8a49dd68 HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel) 2015-04-21 22:38:27 +01:00
Gera Shegalov
6f06e3b7ea MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to the task page. (Siqi Li via gera) 
(cherry picked from commit 89ded89e86e5d9a634d92a5d8a7c889744d97f94)
 2015-04-21 14:21:57 -07:00
Gera Shegalov
1544c63602 HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 
(cherry picked from commit 6d2cf9fbbd02482315a091ab07af26e40cc5134f)
 2015-04-21 14:21:57 -07:00
Gera Shegalov
6f5dc9f5af MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera) 
(cherry picked from commit 725eb52ddc647074f0bf1cc73c3029f1352f51d5)
 2015-04-21 14:21:56 -07:00
Tsuyoshi Ozawa
0b87ae27aa YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 105afd54779852c518b978101f23526143e234a5)
 2015-04-22 05:48:16 +09:00
Allen Wittenauer
b7251723d8 HADOOP-11746. rewrite test-patch.sh (aw) 2015-04-21 21:22:09 +01:00
Colin Patrick Mccabe
447f2f699e HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe) 
(cherry picked from commit 997408eaaceef20b053ee7344468e28cb9a1379b)
 2015-04-21 12:06:33 -07:00
Arun Suresh
d2a9cc287b HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 
(cherry picked from commit 424a00daa069bf2049014fd46ad152ec5fc77ac8)
 2015-04-21 11:35:04 -07:00
Arpit Agarwal
7b3acc5c9d HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:12 -07:00
Vinayakumar B
e7bb0fc922 HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina) 
(cherry picked from commit 8ddbb8dd433862509bd9b222dddafe2c3a74778a)
 2015-04-21 15:27:15 +05:30
Vinod Kumar Vavilapalli
27fc4fb998 Set the release date for 2.7.0 
(cherry picked from commit d52de61544060a04a273114f55979e7e929a576c)
 2015-04-20 20:18:01 -07:00
Vinayakumar B
961051e569 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 
Updated CHANGES.TXT for correct version

(cherry picked from commit ed4137cebf27717e9c79eae515b0b83ab6676465)
 2015-04-21 08:00:37 +05:30