Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,946 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

8946 Commits

Author SHA1 Message Date
Arpit Agarwal 932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Tsuyoshi Ozawa 3884948d6c YARN-3406. Display count of running containers in the RM's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 4a3dabd94f)
 2015-04-25 07:17:42 +09:00
Jason Lowe bd750f160b Fix commit version for YARN-3537 
(cherry picked from commit 78fe6e57c7)
 2015-04-24 22:09:01 +00:00
Jason Lowe cf4154676b YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula 
(cherry picked from commit 5e093f0d40)
 2015-04-24 22:04:03 +00:00
Akira Ajisaka 73ba3ebe7c YARN-3444. Fix typo capabililty. Contributed by Gabor Liptak. 
(cherry picked from commit 5ce3a77f3c)
 2015-04-25 06:09:03 +09:00
Ravi Prakash 122262a1fb HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:48 -07:00
cnauroth 524593ee84 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 
(cherry picked from commit 80935268f5)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-04-24 13:08:47 -07:00
Jian He 0583c27fb1 YARN-3387. Previous AM's container completed status couldn't pass to current AM if AM and RM restarted during the same time. Contributed by Sandflee 
(cherry picked from commit d03dcb9635)
 2015-04-24 12:14:17 -07:00
Andrew Wang 89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 
(cherry picked from commit c7d9ad68e3)
 2015-04-24 11:54:48 -07:00
Jing Zhao 5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 
(cherry picked from commit cf6c8a1b4e)
 2015-04-24 10:24:12 -07:00
Xuan c184466939 YARN-3511. Add errors and warnings page to ATS. Contributed by Varun Vasudev 
(cherry picked from commit eee9facbba)
 2015-04-24 09:43:35 -07:00
Vinayakumar B 2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 
(cherry picked from commit c8d72907ff)
 2015-04-24 12:51:56 +05:30
Vinayakumar B 68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 
(cherry picked from commit 262c1bc339)
 2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe 3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 
(cherry picked from commit a8898445dc)
 2015-04-23 19:15:33 -07:00
Colin Patrick Mccabe 788b76761d HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 
(cherry picked from commit a0e0a63209)
 2015-04-23 19:08:20 -07:00
Haohui Mai b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00
Xuan 8f6053ae51 YARN-3516. killing ContainerLocalizer action doesn't take effect when 
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu

(cherry picked from commit 0b3f8957a8)
 2015-04-23 16:41:52 -07:00
Tsz-Wo Nicholas Sze f27a976a2f HDFS-8215. Refactor NamenodeFsck#check method. Contributed by Takanobu Asanuma 2015-04-23 14:23:02 -07:00
Steve Loughran a6a5d1d6b5 HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) 2015-04-23 21:39:43 +01:00
cnauroth d1253f695d HADOOP-11872. "hadoop dfs" command prints message about using "yarn jar" on Windows(branch-2 only). Contributed by Varun Vasudev. 2015-04-23 13:10:39 -07:00
Tsz-Wo Nicholas Sze d6c8609663 HDFS-8147. StorageGroup in Dispatcher should override equals nad hashCode. Contributed by surendra singh lilhore 2015-04-23 11:56:09 -07:00
Vinod Kumar Vavilapalli 0ec6e7e7f5 YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv) 
(cherry picked from commit f5fe35e297)
 2015-04-23 11:25:30 -07:00
Jian He 48d8d88245 YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen 
(cherry picked from commit aa4a192feb)
 2015-04-23 11:07:54 -07:00
Wangda Tan 9692bcc2c8 YARN-3319. Implement a FairOrderingPolicy. (Craig Welch via wangda) 
(cherry picked from commit 395205444e)
 2015-04-23 10:48:00 -07:00
Arpit Agarwal edbeefdb05 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 2015-04-23 09:35:15 -07:00
tgraves 1cd2fcf25d YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation 
(cherry picked from commit 189a63a719)
 2015-04-23 14:49:24 +00:00
Arun Suresh 889b92fa40 HDFS-4448. Allow HA NN to start in secure mode with wildcard address configured (atm via asuresh) 
(cherry picked from commit baf8bc6c48)
 2015-04-23 01:45:33 -07:00
Steve Loughran 63ccb9167e YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel) 2015-04-23 09:22:23 +01:00
Steve Loughran 4f9b24b90a HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. (Larry McCay via stevel) 2015-04-23 09:06:02 +01:00
cnauroth 4054db5098 HADOOP-11861. test-patch.sh rewrite addendum patch. Contributed by Allen Wittenauer. 
(cherry picked from commit 18eb5e7934)
 2015-04-22 22:23:46 -07:00
Vinod Kumar Vavilapalli 04783b0402 YARN-3366. Enhanced NodeManager to support classifying/shaping outgoing network bandwidth traffic originating from YARN containers Contributed by Sidharta Seethana. 
(cherry picked from commit a100be685c)
 2015-04-22 17:36:55 -07:00
Jason Lowe feb995fc50 HADOOP-11868. Invalid user logins trigger large backtraces in server log. Contributed by Chang Li 
(cherry picked from commit 0ebe84d30a)
 2015-04-22 20:57:46 +00:00
Colin Patrick Mccabe 72b706a1b0 HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c (Malcolm Kavalsky via Colin P. McCabe) 
(cherry picked from commit a3b1d8c902)
 2015-04-22 12:41:07 -07:00
Haohui Mai 71c9f2f4e7 HDFS-8218. Move classes that used by ClientProtocol into hdfs-client. Contributed by Haohui Mai. 2015-04-22 11:33:32 -07:00
Tsuyoshi Ozawa a479669e96 Fix a misleading summary of MAPREDUCE-6330 in CHANGES.txt. 
(cherry picked from commit 252e69f562)
 2015-04-23 03:28:46 +09:00
Tsuyoshi Ozawa 542d53a268 MAPREDUCE-6330. Fix typo in some Task Attempt API's URL. Contributed by Ryu Kobayashi. 
(cherry picked from commit e33594dd87)
 2015-04-23 03:22:02 +09:00
Jitendra Pandey db4419df6b HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman. 2015-04-22 10:02:02 -07:00
Junping Du 8de6045842 New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K 
(cherry picked from commit fad9d7e85b)
 2015-04-22 10:08:16 -07:00
Akira Ajisaka f469f9af2d YARN-3410. Addendum fix for compilation error. Contributed by Rohith. 
(cherry picked from commit b08908ae5e)
 2015-04-22 17:48:55 +09:00
Haohui Mai f02ca4ab15 HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai. 2015-04-21 22:09:13 -07:00
Jian He 613a783380 YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev 
(cherry picked from commit 674c7ef649)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
 2015-04-21 21:06:06 -07:00
Jian He dc4698bb33 YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks 
(cherry picked from commit bdd90110e6)
 2015-04-21 20:34:30 -07:00
Wangda Tan 8a9599fb9e YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda) 2015-04-21 17:47:27 -07:00
Ravi Prakash aa34aa5caa HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:50:40 -07:00
Steve Loughran 6d8a49dd68 HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel) 2015-04-21 22:38:27 +01:00
Gera Shegalov 6f06e3b7ea MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to the task page. (Siqi Li via gera) 
(cherry picked from commit 89ded89e86)
 2015-04-21 14:21:57 -07:00
Gera Shegalov 1544c63602 HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 
(cherry picked from commit 6d2cf9fbbd)
 2015-04-21 14:21:57 -07:00
Gera Shegalov 6f5dc9f5af MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera) 
(cherry picked from commit 725eb52ddc)
 2015-04-21 14:21:56 -07:00
Tsuyoshi Ozawa 0b87ae27aa YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 105afd5477)
 2015-04-22 05:48:16 +09:00
Allen Wittenauer b7251723d8 HADOOP-11746. rewrite test-patch.sh (aw) 2015-04-21 21:22:09 +01:00