Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,672 Commits 326 Branches 371 Tags
Commit Graph

8672 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsuyoshi Ozawa
10745fcecd MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu 
(cherry picked from commit 9d38520c8e42530a817a7f69c9aa73a9ad40639c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2015-03-14 16:45:23 +09:00
Colin Patrick Mccabe
f93a2dd94b Revert "HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)" (Jenkins didn't run yet) 
This reverts commit 7550052b85bc9b73eb94cedc708f682681679b45.
 2015-03-13 18:39:43 -07:00
Colin Patrick Mccabe
7550052b85 HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe) 
(cherry picked from commit 5aa892ed486d42ae6b94c4866b92cd2b382ea640)
 2015-03-13 18:30:36 -07:00
Konstantin V Shvachko
8afbfed5d3 HDFS-2605. Remove redundant "Release 0.21.1" section from CHANGES.txt. Contributed by Allen Wittenauer. 2015-03-13 13:45:13 -07:00
Konstantin V Shvachko
b199081f54 HDFS-7903. Cannot recover block after truncate and delete snapshot. Contributed by Plamen Jeliazkov. 2015-03-13 12:40:38 -07:00
Kihwal Lee
464271a5ed HDFS-7435. PB encoding of block reports is very inefficient. Contributed by Daryn Sharp. 
(cherry picked from commit d324164a51a43d72c02567248bd9f0f12b244a40)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2015-03-13 14:36:34 -05:00
Brandon Li
af80a98ace HDFS-7926. NameNode implementation of ClientProtocol.truncate(..) is not idempotent. Contributed by Tsz Wo Nicholas Sze 
(cherry picked from commit f446669afb5c3d31a00c65449f27088b39e11ae3)
 2015-03-13 10:43:46 -07:00
Jonathan Eagles
44aedad5dd YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles) 
(cherry picked from commit 8180e676abb2bb500a48b3a0c0809d2a807ab235)
 2015-03-13 12:05:21 -05:00
Andrew Wang
146abadb96 HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes. 
(cherry picked from commit 387f271c81f7b3bf53bddc5368d5f4486530c2e1)
 2015-03-12 21:41:29 -07:00
yliu
813c93cb25 HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu) 2015-03-13 02:26:16 +08:00
Yongjun Zhang
32e62cb3d0 HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang) 
(cherry picked from commit 82128774156c30a535b62d764bb6cf9c8d2f3a3b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-12 15:10:20 -07:00
Vinod Kumar Vavilapalli
53aa3a4d1f YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong. 
(cherry picked from commit 863079bb874ba77918ca1c0741eae10e245995c8)
 2015-03-12 13:33:42 -07:00
Colin Patrick Mccabe
7455412a24 HDFS-7722. DataNode#checkDiskError should also remove Storage when error is found. (Lei Xu via Colin P. McCabe) 
(cherry picked from commit b49c3a1813aa8c5b05fe6c02a653286c573137ca)
 2015-03-12 12:40:38 -07:00
Tsz-Wo Nicholas Sze
981a1fa815 HDFS-6833. DirectoryScanner should not register a deleting block with memory of DataNode. Contributed by Shinichi Yamashita 2015-03-13 02:27:37 +08:00
Xuan
498d775c9b YARN-3338. Exclude jline dependency from YARN. Contributed by Zhijie 
Shen

(cherry picked from commit 06ce1d9a6cd9bec25e2f478b98264caf96a3ea44)
 2015-03-12 10:25:55 -07:00
cnauroth
86bb9c5808 HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng. 
(cherry picked from commit ff83ae72318fe6c0f266a7bf08138bd2fdb51cbd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-11 23:28:36 -07:00
Zhijie Shen
426535007b YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong. 
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
 2015-03-11 19:39:46 -07:00
Akira Ajisaka
6c80a3d34a HDFS-7880. Remove the tests for legacy Web UI in branch-2. Contributed by Brahma Reddy Battula. 2015-03-12 10:41:34 +09:00
cnauroth
dcc4850ff3 HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu. 
(cherry picked from commit 7a346bcb4fa5b56191ed00a39e72e51c9bdf1b56)
 2015-03-11 14:37:22 -07:00
Haohui Mai
e75e6c66ea HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. Contributed by Masatake Iwasaki. 2015-03-11 14:23:44 -07:00
cnauroth
5e99b7cd2f HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma. 
(cherry picked from commit fb34f45727e63ea55377fe90241328025307d818)
 2015-03-11 14:11:39 -07:00
Tsuyoshi Ozawa
d29cf296cb YARN-3295. Fix documentation nits found in markdown conversion. Contributed by Masatake Iwasaki. 
(cherry picked from commit 30c428a858c179645d6dc82b7027f6b7e871b439)
 2015-03-11 15:02:45 +09:00
Colin Patrick Mccabe
eefca23e8c HDFS-7830. DataNode does not release the volume lock when adding a volume fails. (Lei Xu via Colin P. McCabe) 
(cherry picked from commit 5c1036d598051cf6af595740f1ab82092b0b6554)
 2015-03-10 19:45:18 -07:00
Gera Shegalov
f1b32d1436 DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera) 
(cherry picked from commit 64eb068ee8863da41df8db44bde1a9033198983d)
 2015-03-10 14:10:39 -07:00
Gera Shegalov
6802e8fefc MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera) 
(cherry picked from commit aa92b764a7ddb888d097121c4d610089a0053d11)
 2015-03-10 11:40:45 -07:00
Jian He
2690c72522 YARN-3187. Documentation of Capacity Scheduler Queue mapping based on user or group. Contributed by Gururaj Shetty 
(cherry picked from commit a380643d2044a4974e379965f65066df2055d003)
 2015-03-10 11:16:51 -07:00
Tsuyoshi Ozawa
482504befd MAPREDUCE-4742. Fix typo in nnbench#displayUsage. Contributed by Liang Xie. 
(cherry picked from commit 20b8ee1350e62d1b21c951e653302b6e6a8e4f7e)
 2015-03-11 00:41:37 +09:00
Junping Du
dbcdcb0d3c Configurable timeout between YARNRunner terminate the application and forcefully kill. Contributed by Eric Payne. 
(cherry picked from commit d39bc903a0069a740744bafe10e506e452ed7018)
 2015-03-10 06:23:24 -07:00
Vinayakumar B
2f902a823c HADOOP-11568. Description on usage of classpath in hadoop command is incomplete. ( Contributed by Archana T ) 2015-03-10 13:02:56 +05:30
Tsuyoshi Ozawa
5efee5efd3 HADOOP-11226. Add a configuration to set ipc.Client's traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITY. Contributed by Gopal V. 
(cherry picked from commit 54639c7d7a34f4a46e8df50d57c79bab34b1ac07)
 2015-03-10 13:09:05 +09:00
Jian He
4021451746 YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong 
(cherry picked from commit c3003eba6f9802f15699564a5eb7c6e34424cb14)
 2015-03-09 20:47:33 -07:00
Akira Ajisaka
2d3c5507ce HDFS-6806. HDFS Rolling upgrade document should mention the versions available. Contributed by J.Andreina. 
(cherry picked from commit 82db3341bfb344f10c4c6cc8eea0d8c19e05956a)
 2015-03-10 11:23:06 +09:00
Zhijie Shen
a94d23762e YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles. 
(cherry picked from commit d6e05c5ee26feefc17267b7c9db1e2a3dbdef117)
 2015-03-09 13:55:51 -07:00
Yongjun Zhang
45cc7514f5 HADOOP-11692. Improve authentication failure WARN message to avoid user confusion. Contributed by Yongjun Zhang. 
(cherry picked from commit de1101cb5be2d8efd0ef4945f64ccfe7cbd01049)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Server.java
 2015-03-09 12:12:29 -07:00
Haohui Mai
d8d8ed35f0 HADOOP-11686. MiniKDC cannot change ORG_NAME or ORG_DOMAIN. Contributed by Duo Zhang. 2015-03-09 11:08:35 -07:00
Jing Zhao
c7105fcff0 HDFS-7898. Change TestAppendSnapshotTruncate to fail-fast. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit e43882e84ae44301eabd0122b5e5492da5fe9f66)
 2015-03-09 10:52:39 -07:00
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Vinod Kumar Vavilapalli
8e6f8e9a04 Adding 2.8 section in CHANGES.txt 2015-03-08 20:26:57 -07:00
Tsuyoshi Ozawa
3c24e50ce2 Update CHANGES.txt for MAPREDUCE-5657. 2015-03-09 12:07:56 +09:00
Tsuyoshi Ozawa
ccde4aed18 MAPREDUCE-5657. Backport '[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments.' Contributed by Akira AJISAKA. 2015-03-09 12:00:04 +09:00
Chris Douglas
3bc4f3502a HDFS-7411. Change decommission logic to throttle by blocks rather 
than nodes in each interval. Contributed by Andrew Wang
 2015-03-08 18:32:20 -07:00
Junping Du
b91e1b0feb YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah 
(cherry picked from commit 7ce3c7635392c32f0504191ddd8417fb20509caa)
 2015-03-08 14:48:42 -07:00
Steve Loughran
b8a2087951 HADOOP-11670. Regression: s3a auth setup broken. (Adam Budde via stevel) 2015-03-08 11:22:01 -07:00
cnauroth
02cadbd24b HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. Contributed by Shashank Khandelwal and Ivan Mitic. 
(cherry picked from commit 608ebd52bafecf980e9726d397c786a9c2422eba)

Conflicts:
	hadoop-project/pom.xml
 2015-03-06 15:29:22 -08:00
Brandon Li
c8af3b2768 HDFS-6488. Support HDFS superuser in NFSv3 gateway. Contributed by Brandon Li 
(cherry picked from commit 0f8ecb1d0ce6d3ee9a7caf5b15b299210c2b8875)
 2015-03-06 15:22:20 -08:00
Jason Lowe
ef3d9bdf6b YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne 
(cherry picked from commit 27e8ea820fab8dce59f4db9814e73bd60c1d4ef1)
 2015-03-06 22:45:09 +00:00
Haohui Mai
ab251fd355 HDFS-7818. OffsetParam should return the default value instead of throwing NPE when the value is unspecified. Contributed by Eric Payne. 2015-03-06 14:26:47 -08:00
Jian He
6cef2c16de YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu 
(cherry picked from commit 21101c01f242439ec8ec40fb3a9ab1991ae0adc7)
 2015-03-06 14:18:56 -08:00
Xuan
56c2050ab7 YARN-3227. Timeline renew delegation token fails when RM user's TGT is 
expired. Contributed by Zhijie Shen

(cherry picked from commit d1abc5d4fc00bb1b226066684556ba16ace71744)
 2015-03-06 13:33:18 -08:00