Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,052 Commits 326 Branches 371 Tags
Commit Graph

2028 Commits

Author SHA1 Message Date
Sangjin Lee
7ee498275e Preparing for 2.6.6 development 2016-09-16 14:22:16 -07:00
Arpit Agarwal
4bc2ece80b HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 
(cherry picked from commit 49a95718754cb6d302371b2421e86da7bce50297)
 2016-09-14 22:08:17 -07:00
Sangjin Lee
9195e81fd4 Remove parent's env vars from child processes (fixed java 1.6 compilation error) 2016-09-14 21:05:26 -07:00
Robert Kanter
c3b7425bf1 Remove parent's env vars from child processes 
(cherry picked from commit b0bcb4e728e91c1c1acc514deb3f2c95626147b2)
 2016-09-14 20:59:22 -07:00
Tsuyoshi Ozawa
d75c8e75f9 HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa) 
(cherry picked from commit 77ffe7621212be9f462ca37a542a13d167eca4e0)
(cherry picked from commit 7c5e7433e143a27763901e471e9f39f41bb24323)
 2016-09-13 21:28:24 -07:00
Lei Xu
76fa5a924e HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) 
(cherry picked from commit 0eb9c60c5bec79f531da8cb3226d7e8b1d7e6639)
(cherry picked from commit 929699f7eb692d1cc0d02cee4d36778e4cd37b96)
 2016-09-13 21:20:22 -07:00
Robert Kanter
f3863cdbd4 HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 
(cherry picked from commit 764f8baa99de35a0ced297b19b0cbe090c615a3b)
(cherry picked from commit d83395031761cb34ee50da5228c9404f0c6e9093)
 2016-09-13 21:14:41 -07:00
stack
fe1c738077 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit b36f29298247f6c5db9f6eff7c2f5177a0fe3de5)
(cherry picked from commit 6d904985e8fbc5abbe9fe9f58badf5e0e1f55825)
 2016-09-13 20:56:53 -07:00
Akira Ajisaka
534cdc8420 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 
(cherry picked from commit fc6b50cc574e144fd314dea6c11987c6a384bfa6)
(cherry picked from commit 39ea0891d2b1369ec8c1ea4312489309e1a85227)
(cherry picked from commit e19cd05a878aafc94cc0de36ac6638d7977c6e6e)
 2016-09-13 20:35:37 -07:00
Kihwal Lee
020ef7f5bb HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d009e76635b2d20ce940851725cb069)
(cherry picked from commit 0bb23e22cef74a6f6dbd46f77288f15fb69a0c03)
 2016-09-13 17:00:30 -07:00
Vinayakumar B
a5424e2a10 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
(cherry picked from commit a9c1bb42418dbde8958dbbc115f6045e696ea2ea)
 2016-09-13 16:22:11 -07:00
Akira Ajisaka
4ed74a917c HADOOP-13579. Fix source-level compatibility after HADOOP-11252. Contributed by Tsuyoshi Ozawa. 2016-09-09 14:30:01 +09:00
Andrew Wang
2586b75004 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-17 13:18:44 -07:00
Tsuyoshi Ozawa
2f546755c8 HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa) 
(cherry picked from commit ea9f43781e5a9a4a6121dd3be106ced6b811754d)
(cherry picked from commit 65adabd0d1bba1c59653cfcd9b4b6253815adb15)
 2016-07-16 08:34:57 +09:00
Zhe Zhang
fc335e5297 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
(cherry picked from commit b95f1af8a9aafb3e482c7b8825f2097f2ceb0e8e)
(cherry picked from commit cbd885b6fa26b7a84a4a19d6084d95665f21378a)
(cherry picked from commit 45ed97e0d2a5a842842c3738f0413345aa633184)
 2016-07-13 16:52:38 -07:00
Akira Ajisaka
59818313d4 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey. 
(cherry picked from commit 7bd5d4272cd686e06c5d5fcc489b69312dacb47b)
(cherry picked from commit 02b037f6257e7379b6bbd656ccbe4472d3f46c40)
 2016-07-11 17:26:46 -07:00
Xiaoyu Yao
392e7e2d06 HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 
(cherry picked from commit ddf66427ff92a3886f94954e21d59e998412059b)
 2016-06-16 20:17:24 -07:00
Konstantin V Shvachko
02b5091a14 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 19:13:53 -07:00
Akira Ajisaka
fbbd1571e6 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-15 13:45:56 +09:00
Vinayakumar B
5eb7b68efe Changed version to 2.6.5-SNAPSHOT 2016-04-12 12:06:27 +05:30
Vinayakumar B
783c99d292 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru) 
(cherry picked from commit 48ca23def1d1c28448a65238814070e79c8f4c4e)
(cherry picked from commit d21bc811d82f685b0a1338bc513d9a925d305a17)

(cherry picked from commit 62da8f6fa688b503ed124313bc2f6f664175d225)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
        hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
 2016-04-06 10:52:28 +08:00
Jason Lowe
c092a8c1bb HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f5f752e266d4fb8e0c808073080bde8)
 2016-03-25 23:05:29 +00:00
Xiaoyu Yao
77deb15c17 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit ab725cff66e8a047e9437e42ac49ac8685ee7a94)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-03-22 14:03:59 -07:00
Xiaoyu Yao
c3f24c6353 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 
Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-03-18 17:50:05 -07:00
Steve Loughran
e17fe26c85 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit f311023f1205b1ea4d51a5b9da5df89f4040af32.
 2016-03-11 16:58:50 +00:00
Masatake Iwasaki
f311023f12 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit acafc950d9347769c3729d571121b3525c6d5eb2)
 2016-03-11 15:39:57 +09:00
Ming Ma
d61a2fd1d0 Update CHANGES.txt for HADOOP-12789 
(cherry picked from commit d6e40fd270c7b552b02c407e2f2dba7deb97177d)
 2016-03-07 20:52:25 -08:00
Ming Ma
5579ee37e3 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff02ea61764f416f0e2ddf81370aec5fb)
(cherry picked from commit f01f1940c4006eeffae679f822463d156c790c04)
 2016-03-07 20:52:12 -08:00
Zhe Zhang
44eef0ed7c HADOOP-12800. Copy docker directory from 2.8 to 2.7/2.6 repos to enable pre-commit Jenkins runs. (zhz) 
Change-Id: I893319c53e497420e2b20511f0d5c0803d8515ba
 2016-02-19 14:34:39 -08:00
Vinayakumar B
89e90becfc HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
(cherry picked from commit e79a5e4460b5199eebb0d788fdc1eaa36d6b0ac4)
 2016-02-16 17:34:19 +05:30
Junping Du
43ac0b09e3 Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)
 2016-02-13 01:51:27 -08:00
Masatake Iwasaki
39970794d7 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 
(cherry picked from commit 36ba5cac37dee6b60e607401ac06d263e4ac5d8f)
 2016-02-13 15:03:54 +09:00
Zhe Zhang
1b25855b9b HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
(cherry picked from commit ef3f3f6bb14cf44bef1778f1091d8ed8a4b764a3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-09 10:20:40 +08:00
Sangjin Lee
7f8c89c33a HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
 2016-02-08 14:00:55 -08:00
Junping Du
89bfc884a5 Adding release 2.6.5 to CHANGES.txt. 2016-02-02 20:28:20 -08:00
Colin Patrick Mccabe
8ef73cd4ce HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 
(cherry picked from commit 6b39ad0865cb2a7960dd59d68178f0bf28865ce2)
(cherry picked from commit e35788aa5a41940651af0b73dfeaeca011556904)
 2016-01-27 08:46:38 -08:00
Junping Du
8b9241f93e Revert HADOOP-12715 which cause build failure on branch-2.6. 2016-01-27 08:14:30 -08:00
Walter Su
d75375a62b HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)
 2016-01-25 19:43:39 +08:00
Akira Ajisaka
ce235e3cba HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
(cherry picked from commit 38ec290455a61a53f1f2c8fcc06f914de52fd5e2)
 2016-01-25 14:00:31 +09:00
Jason Lowe
9b26ee836c HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 
(cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-14 23:53:02 +00:00
Jason Lowe
c5f9fd15d4 HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) 
(cherry picked from commit 8e1bdc17d9134e01115ae7c929503d8ac0325207)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-14 23:35:16 +00:00
Haohui Mai
9cb288e9fa HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru. 
(cherry picked from commit 391d2d88f2ace4e95e82f4303644ba9d1dd0692a)
 2016-01-08 17:09:53 +09:00
Sangjin Lee
51a2e6304a Preparing for 2.6.4 development 2016-01-05 15:40:31 -08:00
Akira Ajisaka
0381556a42 Set release date for 2.6.3 
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
 2016-01-04 16:18:38 +09:00
Akira Ajisaka
1823b3edd0 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
 2016-01-04 14:38:35 +09:00
Zhe Zhang
30dc4334bf HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.6 patch contributed by Xiao Chen. 
Change-Id: Id08ade6862db1b8caf87ac9d786797d4fa7098a0
 2015-12-03 11:01:01 -08:00
Junping Du
e710a11a7f Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:28:37 -08:00
Jason Lowe
53dccddfdb MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-30 17:51:37 +00:00
Jason Lowe
16e3dc24c5 MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d66b1d2a6ac2158be32bd35ad2e69bd)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:15:14 +00:00
Jason Lowe
e307078e78 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7b4b757543a39a6ce8bb6e3be356c6f)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestLineRecordReader.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:07:39 +00:00