Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,338 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12338 Commits

Author SHA1 Message Date
Xiao Chen 8b7d1df766 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 2017-07-14 22:23:13 -07:00
Kihwal Lee e28c74102d HDFS-12140. Remove BPOfferService lock contention to get block pool id. Contributed by Daryn Sharp. 
(cherry picked from commit e7d187a1b6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPOfferService.java
 2017-07-14 16:17:44 -05:00
Kihwal Lee 561b72970f HDFS-12137. DN dataset lock should be fair. Contributed by Daryn Sharp. 
(cherry picked from commit a47820d72a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2017-07-14 15:50:18 -05:00
Jason Lowe 1edc16ee54 YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt 
(cherry picked from commit a5ae5ac50e)
 2017-07-14 15:06:31 -05:00
Ravi Prakash d6228fbebd MAPREDUCE-6910. MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPS. Contributed by Lantao Jin 
(cherry picked from commit 43f0503286)
(cherry picked from commit 756a068143)
 2017-07-13 22:57:44 -07:00
Jason Lowe 8c69b040ac YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe 
(cherry picked from commit a77fb561ef)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
 2017-07-13 18:00:05 -05:00
Jason Lowe 9cff53fed9 YARN-6654. RollingLevelDBTimelineStore backwards incompatible after fst upgrade. Contributed by Jonathan Eagles 
(cherry picked from commit 5f1ee72b0e)
 2017-07-13 17:30:57 -05:00
Akira Ajisaka c180005fcf MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. Contributed by Nathan Roberts. 
(cherry picked from commit a5c0476a99)
 2017-07-13 13:30:33 -07:00
Masatake Iwasaki 7c8d4a1b3f HADOOP-14646. FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs. Contributed by Andras Bokor. 
(cherry picked from commit b61ab8573e)
 2017-07-13 21:52:34 +09:00
Xiaoyu Yao c9adca70e6 HDFS-11502. Datanode UI should display hostname based on JMX bean instead of window.location.hostname. Contributed by Jeffrey E Rodriguez and Yuanbo Liu. 
(cherry picked from commit e15e2713e1)
 2017-07-12 16:39:22 -07:00
Jason Lowe 4f1dfcc118 YARN-6797. TimelineWriter does not fully consume the POST response. Contributed by Jason Lowe 
(cherry picked from commit 655110393b)
 2017-07-12 15:54:49 -05:00
Junping Du 28be69ae6d MAPREDUCE-5621. mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time. Contributed by Shinichi Yamashita. 
(cherry picked from commit ea3dba37cd)
 2017-07-12 12:54:35 -07:00
Akira Ajisaka ebb66d2038
YARN-6809. Fix typo in ResourceManagerHA.md. Contributed by Yeliang Cang. 
(cherry picked from commit b628d0da51)
(cherry picked from commit 3419381e98)
 2017-07-12 19:39:29 +09:00
Akira Ajisaka d1fb4948d2
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor. 
(cherry picked from commit 9144fd9e9b)
(cherry picked from commit 2653cf4466)
 2017-07-12 11:44:15 +09:00
Xiao Chen 83eacccc17 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc7593)
(cherry picked from commit 05ed48b75a)
 2017-07-10 13:48:12 -07:00
Naganarasimha 0f9f7bb0c6 YARN-6770. A small mistake in the example of TimelineClient. Contributed by Jinjiang Ling. 
(cherry picked from commit ba5b056e8a)
 2017-07-09 21:40:16 +05:30
Naganarasimha ad70e929b2 YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundutt. 2017-07-09 17:34:47 +05:30
Junping Du 5ad710bc7a MAPREDUCE-6246. DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2. Contributed by ramtin and Gergely Novák. 
(cherry picked from commit f484a6ff60)
(cherry picked from commit f823f9fd78)
 2017-07-07 13:32:21 -07:00
Wei-Chiu Chuang d657c05177 HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah. 
(cherry picked from commit 8153fe2bd3)
(cherry picked from commit 730b21e9f9)
 2017-07-07 06:14:32 -07:00
Eric Payne 8949a9d541 YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G) 2017-07-06 10:53:47 -05:00
Jason Lowe cd895d0586 YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt 
(cherry picked from commit 7576a688ea)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ContainerLocalizer.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestContainerLocalizer.java
 2017-07-06 09:53:13 -05:00
Jason Lowe c8e6012f62 MAPREDUCE-6911. TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently. Contributed by Eric Badger 
(cherry picked from commit f0435db089)
 2017-07-06 09:24:01 -05:00
Mingliang Liu db6e8ff747 HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 
(cherry picked from commit 6436768baf)
 2017-07-05 11:12:41 -07:00
Vinayakumar B cd6ee04274 HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore. 
(cherry picked from commit 1e8301b215)
 2017-07-05 16:07:18 +05:30
Akira Ajisaka 71f49406f2
MAPREDUCE-6909. LocalJobRunner fails when run on a node from multiple users. Contributed by Jason Lowe. 
(cherry picked from commit ac333155fb)
 2017-07-04 15:26:46 +09:00
Akira Ajisaka 9f9d554edf
HDFS-12078. Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml. Contributed by Weiwei Yang. 
(cherry picked from commit 186650d21d)
(cherry picked from commit 063f2132ef)
 2017-07-04 14:53:02 +09:00
Naganarasimha acc504dc58 MAPREDUCE-6905. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh. Contributed by LiXin Ge. 
(cherry picked from commit bf1f59937d)
 2017-07-02 16:18:30 +05:30
Naganarasimha 69480ba686 YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp. 2017-07-01 12:58:36 +05:30
Wei-Chiu Chuang 8027246306 HDFS-12042. Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption. Contributed by Misha Dmitriev. 
(cherry picked from commit bcba844d11)
(cherry picked from commit 94bc5cdbb3)
 2017-06-30 11:43:41 -07:00
bibinchundatt f6fcbf426f YARN-6749. TestAppSchedulingInfo.testPriorityAccounting fails consistently. Contributed by Naganarasimha G R 2017-06-30 21:52:16 +05:30
John Zhuge 2956c584c3 HADOOP-14024. KMS JMX endpoint throws ClassNotFoundException. Contributed by John Zhuge. 
(cherry picked from commit 1272ee153b)
 2017-06-29 16:27:50 -07:00
Wei-Chiu Chuang 7c076f917f HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 
(cherry picked from commit 16c8dbde57)
(cherry picked from commit 6917c19167)
 2017-06-29 06:44:37 -07:00
Naganarasimha 29c68ccc6f YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R. 2017-06-29 00:25:32 +05:30
Xiao Chen ddd3e7a4db HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit aff7a3f8eddd55501366a43d2f44f531c6e8ef48)
 2017-06-27 23:49:23 -07:00
Jason Lowe 486dc3f9eb YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich 
(cherry picked from commit 63ce1593c5)
 2017-06-27 17:14:30 -05:00
Kihwal Lee bdbf737ef3 Addendum for HADOOP-14146. Use commons Base64 instead of jdk8 Base64. 
(cherry picked from commit 0719345909)
 2017-06-23 13:28:16 -05:00
Kihwal Lee fa695817e5 Addendum for HADOOP-14146 jdk7 support. 
(cherry picked from commit 4c6184b41c)
 2017-06-23 10:00:26 -05:00
Daryn Sharp 81eb06b553 HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp 2017-06-21 11:48:05 -05:00
Kihwal Lee a560104fab HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b)
 2017-06-20 12:12:33 -05:00
Kihwal Lee e87bf17129 HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao. 
(cherry picked from commit 972782d956)
(cherry picked from commit f8c9c0ff0e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMetadataConsistency.java
 2017-06-20 12:10:43 -05:00
Kihwal Lee 1f9255672d Revert "HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee." 
This reverts commit 40e3cd24b0.
 2017-06-20 09:22:25 -05:00
Kihwal Lee 40e3cd24b0 HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b)
 2017-06-20 09:20:02 -05:00
Brahma Reddy Battula a526c3b0bf HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han. 
(cherry picked from commit 2e9daa2e27)
 2017-06-20 20:46:21 +08:00
Akira Ajisaka f16524ec9f
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang. 
(cherry picked from commit 099dfe92a9)
(cherry picked from commit 35f6c7c9c7)
 2017-06-20 17:47:25 +09:00
Akira Ajisaka 189e39a90d
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 
(cherry picked from commit 2c769167db)
(cherry picked from commit 6b3c13d543)
 2017-06-20 16:41:10 +09:00
Xiao Chen b89783e00e HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit 4cdae5d88ef7851ae284a115868dc4bbe24ae1bd)
 2017-06-19 23:12:35 -07:00
Akira Ajisaka 6a4a63b0fd
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 71626fd0b9)
 2017-06-20 13:56:20 +09:00
Masatake Iwasaki 6032511239 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 
(cherry picked from commit d954a64730)
 2017-06-20 09:25:05 +09:00
Naganarasimha 363ef7b8ad YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp 
(cherry picked from commit ee89ac84e6)
 2017-06-19 22:49:28 +05:30
Akira Ajisaka 4250250c7b
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong. 
(cherry picked from commit 300804595e)
(cherry picked from commit 6d82db40d5)
 2017-06-19 19:40:44 +09:00